2024-09-05T07:30:44.585 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T07:30:44.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T07:30:44.694 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7890031' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1743 sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 sleep_before_teardown: 0 subset: 459/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3BVyPPpgCDG9/gbqm/1P/clmDxw0HyIiZGpNeiirfuTHoSlUS62LZNl3Q3BNFtbbYA2/hUaI8x5TJavpJXw8I= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIoq6dvV7O6bcIbMHnCp8a2W4LHoow/fbEiNt++b129+wwiHzffnSzeP7ipAGkb6g/3TXno3SeFI6i+H09lmwz8= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHcFlGvDoNR9t23Cgbh2cYmzWiLpfc5CxfZw5EmplfSmhSZAezjYqAmnfxGAZFqfkPDEYAFHPcu2UV4FU1aChA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-04_21:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T07:30:44.694 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa; will attempt to use it 2024-09-05T07:30:44.695 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks 2024-09-05T07:30:44.695 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T07:30:44.697 INFO:teuthology.task.internal:Checking packages... 2024-09-05T07:30:44.718 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4' 2024-09-05T07:30:44.718 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T07:30:44.718 INFO:teuthology.packaging:ref: None 2024-09-05T07:30:44.718 INFO:teuthology.packaging:tag: None 2024-09-05T07:30:44.718 INFO:teuthology.packaging:branch: squid 2024-09-05T07:30:44.718 INFO:teuthology.packaging:sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:30:44.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-05T07:30:44.939 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-259.g91c8a7e5 2024-09-05T07:30:44.941 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T07:30:44.947 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T07:30:44.947 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T07:30:44.953 INFO:teuthology.task.internal:Saving configuration 2024-09-05T07:30:44.971 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T07:30:44.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T07:30:45.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 07:25:40.615746', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3BVyPPpgCDG9/gbqm/1P/clmDxw0HyIiZGpNeiirfuTHoSlUS62LZNl3Q3BNFtbbYA2/hUaI8x5TJavpJXw8I='} 2024-09-05T07:30:45.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 07:25:40.617218', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIoq6dvV7O6bcIbMHnCp8a2W4LHoow/fbEiNt++b129+wwiHzffnSzeP7ipAGkb6g/3TXno3SeFI6i+H09lmwz8='} 2024-09-05T07:30:45.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 07:25:40.618473', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHcFlGvDoNR9t23Cgbh2cYmzWiLpfc5CxfZw5EmplfSmhSZAezjYqAmnfxGAZFqfkPDEYAFHPcu2UV4FU1aChA='} 2024-09-05T07:30:45.047 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T07:30:45.053 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-05T07:30:45.053 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-05T07:30:45.053 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-05T07:30:45.053 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T07:30:45.135 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f29c0473f40>, signals=[15]) 2024-09-05T07:30:45.136 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T07:30:45.141 INFO:teuthology.task.internal:Opening connections... 2024-09-05T07:30:45.141 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:30:45.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:30:45.221 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-05T07:30:45.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:30:45.301 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-05T07:30:45.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:30:45.382 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T07:30:45.389 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-05T07:30:45.407 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-05T07:30:45.408 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T07:30:45.466 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T07:30:45.467 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T07:30:45.467 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-05T07:30:45.490 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-05T07:30:45.509 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-05T07:30:45.509 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-05T07:30:45.567 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T07:30:45.568 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-05T07:30:45.569 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T07:30:45.569 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T07:30:45.569 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T07:30:45.569 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-05T07:30:45.590 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-05T07:30:45.608 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-05T07:30:45.609 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-05T07:30:45.667 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T07:30:45.668 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-05T07:30:45.668 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T07:30:45.668 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T07:30:45.668 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T07:30:45.668 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-05T07:30:45.690 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T07:30:45.700 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T07:30:45.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T07:30:45.705 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-05T07:30:45.708 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-05T07:30:45.710 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-05T07:30:45.726 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T07:30:45.732 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T07:30:45.732 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-05T07:30:45.765 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-05T07:30:45.768 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-05T07:30:45.888 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T07:30:45.963 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T07:30:45.977 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-05T07:30:45.978 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-05T07:30:45.978 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-05T07:30:45.978 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T07:30:45.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:30:45.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-05T07:30:46.176 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T07:30:46.176 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-09-05T07:30:46.176 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-05T07:30:46.194 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-503.el9.x86_64 2024-09-05T07:30:46.194 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T07:30:46.194 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-05T07:30:46.195 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2024-09-05T07:30:52.287 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.2 MB 00:04 2024-09-05T07:30:54.021 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-05T07:30:59.389 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-05T07:31:00.998 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-05T07:31:01.910 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-05T07:31:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-05T07:31:09.414 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-05T07:31:09.415 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-05T07:31:09.415 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-05T07:31:09.500 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-09-05T07:31:09.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T07:31:09.654 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ 2024-09-05T07:31:09.655 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-05T07:31:09.657 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-09-05T07:31:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05 07:31:15 URL:https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm [359646365/359646365] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-05T07:31:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2024-09-05 07:31:15-- 2024-09-05T07:31:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 6.3s 2024-09-05T07:31:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-05T07:31:15.970 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-09-05T07:31:15.971 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-05T07:31:18.093 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2024-09-05T07:31:18.327 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2024-09-05T07:31:18.449 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2024-09-05T07:31:26.519 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.11.0_rc5_g8ad8b8b16098-1 ######################################## 2024-09-05T07:32:06.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-05T07:32:06.547 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-05T07:32:06.642 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.643 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.643 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/System.map 2024-09-05T07:32:06.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/config 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-05T07:32:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-05T07:32:06.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-05T07:32:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-05T07:32:06.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-05T07:32:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-09-05T07:32:06.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-09-05T07:32:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-09-05T07:32:06.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-09-05T07:32:06.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecc.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecdh_generic.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-09-05T07:32:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-09-05T07:32:06.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-09-05T07:32:06.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ata_generic.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-09-05T07:32:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-09-05T07:32:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-09-05T07:32:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-09-05T07:32:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sis.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-09-05T07:32:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap 2024-09-05T07:32:06.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-09-05T07:32:06.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/brd.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/loop.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-09-05T07:32:06.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/virtio_blk.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkfront.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-05T07:32:06.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave 2024-09-05T07:32:06.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/uv_mmtimer.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/virtio_console.ko 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq 2024-09-05T07:32:06.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common 2024-09-05T07:32:06.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw 2024-09-05T07:32:06.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-09-05T07:32:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/edd.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-05T07:32:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-05T07:32:06.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-09-05T07:32:06.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-05T07:32:06.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-09-05T07:32:06.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-09-05T07:32:06.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-09-05T07:32:06.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-09-05T07:32:06.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-09-05T07:32:06.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-09-05T07:32:06.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-09-05T07:32:06.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-09-05T07:32:06.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-09-05T07:32:06.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-05T07:32:06.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-09-05T07:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-09-05T07:32:06.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-05T07:32:06.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-05T07:32:06.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-dev.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-05T07:32:06.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4 2024-09-05T07:32:06.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-05T07:32:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport 2024-09-05T07:32:06.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-09-05T07:32:06.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-09-05T07:32:06.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-05T07:32:06.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-09-05T07:32:06.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-09-05T07:32:06.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mfd-core.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc 2024-09-05T07:32:06.697 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-09-05T07:32:06.698 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-09-05T07:32:06.699 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx 2024-09-05T07:32:06.700 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-05T07:32:06.701 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-05T07:32:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-05T07:32:06.703 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-05T07:32:06.704 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-05T07:32:06.705 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-05T07:32:06.706 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-09-05T07:32:06.707 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf 2024-09-05T07:32:06.708 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-05T07:32:06.709 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-05T07:32:06.710 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia 2024-09-05T07:32:06.711 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc 2024-09-05T07:32:06.712 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis 2024-09-05T07:32:06.713 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-05T07:32:06.714 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-05T07:32:06.715 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan 2024-09-05T07:32:06.716 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/net_failover.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-09-05T07:32:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/dp83640.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-09-05T07:32:06.718 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-09-05T07:32:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip 2024-09-05T07:32:06.720 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slhc.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tun.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-09-05T07:32:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/virtio_net.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netfront.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-09-05T07:32:06.722 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-05T07:32:06.723 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-09-05T07:32:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-09-05T07:32:06.725 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps 2024-09-05T07:32:06.726 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-05T07:32:06.727 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-05T07:32:06.728 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-05T07:32:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-09-05T07:32:06.730 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi 2024-09-05T07:32:06.731 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi 2024-09-05T07:32:06.732 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r 2024-09-05T07:32:06.733 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-09-05T07:32:06.734 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-05T07:32:06.735 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-09-05T07:32:06.736 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-05T07:32:06.737 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-05T07:32:06.738 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal 2024-09-05T07:32:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-05T07:32:06.740 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250 2024-09-05T07:32:06.741 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-09-05T07:32:06.742 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-09-05T07:32:06.743 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-09-05T07:32:06.744 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-09-05T07:32:06.745 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-05T07:32:06.746 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-09-05T07:32:06.747 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage 2024-09-05T07:32:06.748 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-05T07:32:06.749 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-09-05T07:32:06.750 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_balloon.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_mmio.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-05T07:32:06.751 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_ring.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-05T07:32:06.752 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-05T07:32:06.753 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-05T07:32:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-09-05T07:32:06.755 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs 2024-09-05T07:32:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-09-05T07:32:06.757 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/fat.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/vfat.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/fuse.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-09-05T07:32:06.758 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs 2024-09-05T07:32:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd 2024-09-05T07:32:06.760 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-09-05T07:32:06.761 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-09-05T07:32:06.762 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-09-05T07:32:06.763 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-09-05T07:32:06.764 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-09-05T07:32:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs 2024-09-05T07:32:06.766 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-09-05T07:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu/rcutorture.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace 2024-09-05T07:32:06.769 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/asn1_encoder.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libaescfb.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-09-05T07:32:06.770 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd/zstd_compress.ko 2024-09-05T07:32:06.771 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802 2024-09-05T07:32:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv 2024-09-05T07:32:06.773 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-05T07:32:06.774 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-05T07:32:06.775 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/failover.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver/dns_resolver.ko 2024-09-05T07:32:06.776 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4 2024-09-05T07:32:06.777 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-05T07:32:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-05T07:32:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-09-05T07:32:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-09-05T07:32:06.781 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-05T07:32:06.782 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-05T07:32:06.783 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-09-05T07:32:06.784 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-05T07:32:06.785 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-05T07:32:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-05T07:32:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-05T07:32:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-09-05T07:32:06.789 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-09-05T07:32:06.790 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_quota.ko 2024-09-05T07:32:06.791 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tunnel.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-05T07:32:06.792 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-09-05T07:32:06.793 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-09-05T07:32:06.794 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-09-05T07:32:06.795 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-09-05T07:32:06.796 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh 2024-09-05T07:32:06.797 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-09-05T07:32:06.798 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-09-05T07:32:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-09-05T07:32:06.800 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-09-05T07:32:06.801 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-09-05T07:32:06.802 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-05T07:32:06.803 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security 2024-09-05T07:32:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys 2024-09-05T07:32:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys 2024-09-05T07:32:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-05T07:32:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys 2024-09-05T07:32:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys/trusted.ko 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-09-05T07:32:06.805 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-09-05T07:32:06.806 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-09-05T07:32:06.806 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.weakdep 2024-09-05T07:32:06.806 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-09-05T07:32:06.809 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.810 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-05T07:32:06.832 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g8ad8b8b16098 /lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout:for file in vmlinuz System.map config; do 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098"; then 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout: cp "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout: fi 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-09-05T07:32:06.833 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -d "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" ] && \ 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" >/dev/null 2>&1; then 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout: cp -r "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep" ]; then 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/sbin/depmod 6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.834 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-05T07:32:06.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 82.el9 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-09-05T07:32:06.908 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8274670 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-09-05T07:32:06.909 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:32:06.910 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-09-05T07:32:06.911 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-05T07:32:06.911 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:06.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-05T07:32:07.524 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-05T07:32:08.948 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-05T07:32:08.984 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-05T07:32:08.987 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-05T07:32:09.002 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.tXOyexNheZ 2024-09-05T07:32:09.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tXOyexNheZ 2024-09-05T07:32:09.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.tXOyexNheZ 2024-09-05T07:32:09.204 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.tXOyexNheZ is 6KB 2024-09-05T07:32:09.225 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.tXOyexNheZ 2024-09-05T07:32:09.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-09-05T07:32:09.303 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-05T07:32:09.303 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-05T07:32:09.303 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-05T07:32:09.303 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098.conf 2024-09-05T07:32:09.304 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:32:09.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-09-05T07:32:39.484 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-05T07:32:39.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-05T07:32:39.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:33:39.490 DEBUG:teuthology.orchestra.remote:timed out 2024-09-05T07:33:48.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-05T07:33:48.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:33:49.162 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-05T07:33:49.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-05T07:33:49.665 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-09-05T07:33:49.665 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-05T07:33:49.699 INFO:teuthology.orchestra.run.smithi144.stdout:6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:33:49.699 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-09-05T07:33:49.699 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T07:33:49.699 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-05T07:33:50.703 DEBUG:teuthology.parallel:result is None 2024-09-05T07:33:50.703 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T07:33:50.710 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T07:33:50.710 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T07:33:50.715 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T07:33:50.717 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T07:33:50.746 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T07:33:50.751 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T07:33:50.760 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T07:33:50.761 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T07:33:50.789 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T07:33:50.792 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T07:33:50.909 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T07:33:50.918 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T07:33:50.918 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T07:33:50.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:33:50.936 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T07:33:50.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:33:50.953 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T07:33:50.957 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T07:33:50.979 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T07:33:51.049 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.060 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.066 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.074 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.080 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.131 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:33:51.134 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T07:33:51.142 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T07:33:51.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T07:33:51.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T07:33:51.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T07:33:51.198 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T07:33:51.208 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T07:33:51.208 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T07:33:51.212 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T07:33:51.218 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T07:33:51.242 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:51.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:51.426 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:51.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:51.561 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:33:51.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T07:33:51.669 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:51.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:51.800 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:51.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:51.889 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:33:51.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T07:33:51.957 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:52.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:33:52.066 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:52.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:33:52.154 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:33:52.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T07:33:52.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-05T07:33:52.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-05T07:33:52.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-05T07:33:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:33:52.297 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:33:52.309 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:33:52.770 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T07:33:53.068 INFO:teuthology.task.internal:Starting timer... 2024-09-05T07:33:53.068 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T07:33:53.086 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T07:33:53.096 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-05T07:33:53.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-05T07:33:53.173 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-05T07:33:53.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-05T07:33:53.250 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-05T07:33:53.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-05T07:33:53.308 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-05T07:33:53.310 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T07:33:53.310 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-05T07:33:53.352 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-05T07:33:53.352 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-05T07:33:53.376 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-05T07:33:53.376 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-05T07:33:53.402 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-05T07:33:53.402 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-05T07:33:53.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:33:53.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:33:53.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:33:53.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:33:53.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:33:53.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:33:53.518 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T07:33:53.518 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-05T07:33:53.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-05T07:33:53.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-05T07:33:53.734 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T07:33:53.744 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T07:33:53.758 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T07:33:53.759 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T07:38:28.089 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-05T07:38:28.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-05T07:38:28.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:38:28.181 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-05T07:38:28.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-05T07:38:28.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-05T07:38:28.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:38:28.369 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-05T07:38:28.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-05T07:38:28.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-05T07:38:28.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:38:28.536 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-05T07:38:28.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-05T07:38:28.622 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T07:38:28.634 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T07:38:28.634 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T07:38:28.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:38:28.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T07:38:28.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:38:28.641 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T07:38:28.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:38:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T07:38:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T07:38:28.694 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T07:38:28.698 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T07:38:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-05T07:38:28.709 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T07:38:28.719 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-05T07:38:28.728 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T07:38:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T07:38:28.735 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-05T07:38:28.747 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-05T07:38:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T07:38:28.761 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T07:38:28.776 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T07:38:28.779 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-05T07:38:28.803 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-05T07:38:28.807 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:38:28.810 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:38:28.810 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-05T07:38:28.810 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.811 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.811 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.811 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T07:38:28.841 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.845 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T07:38:28.963 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:38:28.970 INFO:teuthology.run_tasks:Running task install... 2024-09-05T07:38:28.978 DEBUG:teuthology.task.install:project ceph 2024-09-05T07:38:28.978 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}} 2024-09-05T07:38:28.978 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'} 2024-09-05T07:38:28.978 INFO:teuthology.task.install:Using flavor: default 2024-09-05T07:38:28.983 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-05T07:38:28.984 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-05T07:38:28.984 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T07:38:28.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:38:28.987 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T07:38:28.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:38:28.988 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T07:38:28.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:38:29.132 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T07:38:29.132 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T07:38:29.136 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T07:38:29.136 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T07:38:29.144 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T07:38:29.144 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T07:38:29.242 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T07:38:29.242 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:38:29.243 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T07:38:29.250 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T07:38:29.250 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:38:29.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T07:38:29.256 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T07:38:29.256 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:38:29.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T07:38:29.276 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T07:38:29.277 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T07:38:29.282 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T07:38:29.282 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T07:38:29.299 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T07:38:29.299 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T07:38:29.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T07:38:29.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T07:38:29.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T07:38:29.418 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T07:38:29.422 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T07:38:29.475 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T07:38:29.482 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-05T07:38:29.484 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-05T07:38:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-05T07:38:29.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-05T07:38:29.530 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-05T07:38:29.533 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-05T07:38:29.707 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-05T07:38:29.715 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-05T07:38:29.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T07:38:29.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T07:38:29.807 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-05T07:38:29.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T07:38:30.282 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-05T07:38:30.302 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-05T07:38:30.524 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 284 kB/s | 84 kB 00:00 2024-09-05T07:38:30.557 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-05T07:38:30.587 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-05T07:38:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-05T07:38:30.833 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-05T07:38:30.862 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-05T07:38:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-05T07:38:31.283 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-05T07:38:32.337 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-05T07:38:33.092 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-05T07:38:33.209 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-05T07:38:34.430 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-05T07:38:37.852 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 20 MB 00:03 2024-09-05T07:38:38.418 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-05T07:38:38.730 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-05T07:38:39.843 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-05T07:38:40.248 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-05T07:38:41.189 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-05T07:38:41.318 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-05T07:38:43.244 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-05T07:38:45.194 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-05T07:38:46.093 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-05T07:38:46.503 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-05T07:38:46.949 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-05T07:38:48.757 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:48.757 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:48.771 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T07:38:48.772 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T07:38:48.772 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T07:38:48.773 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T07:38:48.775 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T07:38:48.778 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T07:38:48.779 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T07:38:48.840 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T07:38:48.860 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T07:38:48.861 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T07:38:48.862 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T07:38:48.863 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T07:38:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T07:38:48.865 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T07:38:48.866 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T07:38:48.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T07:38:48.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T07:38:48.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T07:38:48.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T07:38:48.871 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T07:38:48.872 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 6 Packages 2024-09-05T07:38:48.873 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:38:48.874 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 222 M 2024-09-05T07:38:48.874 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-05T07:38:49.184 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:49.185 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:49.196 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T07:38:49.197 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T07:38:49.198 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T07:38:49.199 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T07:38:49.200 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T07:38:49.203 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T07:38:49.204 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T07:38:49.266 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-05T07:38:49.288 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T07:38:49.289 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T07:38:49.290 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T07:38:49.291 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T07:38:49.292 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T07:38:49.293 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T07:38:49.294 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T07:38:49.294 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T07:38:49.294 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T07:38:49.294 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T07:38:49.294 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T07:38:49.295 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T07:38:49.295 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T07:38:49.295 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T07:38:49.295 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T07:38:49.295 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T07:38:49.296 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T07:38:49.297 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T07:38:49.298 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T07:38:49.299 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T07:38:49.300 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T07:38:49.301 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T07:38:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T07:38:49.303 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-05T07:38:49.304 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-05T07:38:49.305 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-05T07:38:49.305 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 6 Packages 2024-09-05T07:38:49.305 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:38:49.305 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 222 M 2024-09-05T07:38:49.306 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-05T07:38:49.596 INFO:teuthology.orchestra.run.smithi175.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-05T07:38:49.742 INFO:teuthology.orchestra.run.smithi154.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-05T07:38:49.788 INFO:teuthology.orchestra.run.smithi175.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-05T07:38:49.905 INFO:teuthology.orchestra.run.smithi175.stdout:(3/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-05T07:38:49.930 INFO:teuthology.orchestra.run.smithi175.stdout:(4/154): ceph-immutable-object-cache-19.1.1-259 1.0 MB/s | 145 kB 00:00 2024-09-05T07:38:50.055 INFO:teuthology.orchestra.run.smithi175.stdout:(5/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 16 MB/s | 2.4 MB 00:00 2024-09-05T07:38:50.105 INFO:teuthology.orchestra.run.smithi175.stdout:(6/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-05T07:38:50.356 INFO:teuthology.orchestra.run.smithi175.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-05T07:38:50.393 INFO:teuthology.orchestra.run.smithi154.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-05T07:38:50.559 INFO:teuthology.orchestra.run.smithi154.stdout:(3/154): ceph-immutable-object-cache-19.1.1-259 875 kB/s | 145 kB 00:00 2024-09-05T07:38:50.714 INFO:teuthology.orchestra.run.smithi175.stdout:(8/154): ceph-common-19.1.1-259.g91c8a7e5.el9.x 17 MB/s | 21 MB 00:01 2024-09-05T07:38:50.764 INFO:teuthology.orchestra.run.smithi175.stdout:(9/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9. 505 kB/s | 25 kB 00:00 2024-09-05T07:38:51.048 INFO:teuthology.orchestra.run.smithi175.stdout:(10/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 15 MB/s | 11 MB 00:00 2024-09-05T07:38:51.107 INFO:teuthology.orchestra.run.smithi175.stdout:(11/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 3.8 MB/s | 224 kB 00:00 2024-09-05T07:38:51.174 INFO:teuthology.orchestra.run.smithi175.stdout:(12/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 406 kB/s | 27 kB 00:00 2024-09-05T07:38:51.240 INFO:teuthology.orchestra.run.smithi175.stdout:(13/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 476 kB/s | 32 kB 00:00 2024-09-05T07:38:51.324 INFO:teuthology.orchestra.run.smithi175.stdout:(14/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-05T07:38:51.508 INFO:teuthology.orchestra.run.smithi175.stdout:(15/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 12 MB/s | 17 MB 00:01 2024-09-05T07:38:51.518 INFO:teuthology.orchestra.run.smithi154.stdout:(4/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-09-05T07:38:51.533 INFO:teuthology.orchestra.run.smithi175.stdout:(16/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 783 kB/s | 163 kB 00:00 2024-09-05T07:38:51.566 INFO:teuthology.orchestra.run.smithi175.stdout:(17/154): librados-devel-19.1.1-259.g91c8a7e5.e 2.1 MB/s | 127 kB 00:00 2024-09-05T07:38:51.600 INFO:teuthology.orchestra.run.smithi175.stdout:(18/154): libradosstriper1-19.1.1-259.g91c8a7e5 7.4 MB/s | 506 kB 00:00 2024-09-05T07:38:51.659 INFO:teuthology.orchestra.run.smithi175.stdout:(19/154): python3-ceph-argparse-19.1.1-259.g91c 773 kB/s | 45 kB 00:00 2024-09-05T07:38:51.734 INFO:teuthology.orchestra.run.smithi175.stdout:(20/154): python3-ceph-common-19.1.1-259.g91c8a 1.8 MB/s | 136 kB 00:00 2024-09-05T07:38:51.801 INFO:teuthology.orchestra.run.smithi175.stdout:(21/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 2.4 MB/s | 162 kB 00:00 2024-09-05T07:38:51.877 INFO:teuthology.orchestra.run.smithi175.stdout:(22/154): python3-rados-19.1.1-259.g91c8a7e5.el 4.2 MB/s | 321 kB 00:00 2024-09-05T07:38:51.985 INFO:teuthology.orchestra.run.smithi175.stdout:(23/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-05T07:38:52.010 INFO:teuthology.orchestra.run.smithi175.stdout:(24/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 2.2 MB/s | 301 kB 00:00 2024-09-05T07:38:52.027 INFO:teuthology.orchestra.run.smithi175.stdout:(25/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 2.3 MB/s | 99 kB 00:00 2024-09-05T07:38:52.052 INFO:teuthology.orchestra.run.smithi175.stdout:(26/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 2.0 MB/s | 85 kB 00:00 2024-09-05T07:38:52.068 INFO:teuthology.orchestra.run.smithi154.stdout:(5/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 2.8 MB/s | 1.5 MB 00:00 2024-09-05T07:38:52.128 INFO:teuthology.orchestra.run.smithi175.stdout:(27/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-05T07:38:52.194 INFO:teuthology.orchestra.run.smithi175.stdout:(28/154): ceph-grafana-dashboards-19.1.1-259.g9 479 kB/s | 32 kB 00:00 2024-09-05T07:38:52.261 INFO:teuthology.orchestra.run.smithi175.stdout:(29/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-05T07:38:52.287 INFO:teuthology.orchestra.run.smithi175.stdout:(30/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 1.6 MB/s | 146 kB 00:00 2024-09-05T07:38:52.443 INFO:teuthology.orchestra.run.smithi154.stdout:(6/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 1.9 MB/s | 5.4 MB 00:02 2024-09-05T07:38:52.471 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-05T07:38:52.895 INFO:teuthology.orchestra.run.smithi175.stdout:(31/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 23 MB/s | 49 MB 00:02 2024-09-05T07:38:52.954 INFO:teuthology.orchestra.run.smithi175.stdout:(32/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 5.1 MB/s | 3.6 MB 00:00 2024-09-05T07:38:52.979 INFO:teuthology.orchestra.run.smithi175.stdout:(33/154): ceph-mgr-modules-core-19.1.1-259.g91c 2.9 MB/s | 249 kB 00:00 2024-09-05T07:38:53.004 INFO:teuthology.orchestra.run.smithi175.stdout:(34/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 986 kB/s | 49 kB 00:00 2024-09-05T07:38:53.029 INFO:teuthology.orchestra.run.smithi175.stdout:(35/154): ceph-prometheus-alerts-19.1.1-259.g91 329 kB/s | 16 kB 00:00 2024-09-05T07:38:53.055 INFO:teuthology.orchestra.run.smithi175.stdout:(36/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 5.6 MB/s | 285 kB 00:00 2024-09-05T07:38:53.097 INFO:teuthology.orchestra.run.smithi175.stdout:(37/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 11 MB/s | 765 kB 00:00 2024-09-05T07:38:53.113 INFO:teuthology.orchestra.run.smithi175.stdout:(38/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 311 kB/s | 18 kB 00:00 2024-09-05T07:38:53.206 INFO:teuthology.orchestra.run.smithi175.stdout:(39/154): ceph-mgr-diskprediction-local-19.1.1- 8.1 MB/s | 7.4 MB 00:00 2024-09-05T07:38:53.243 INFO:teuthology.orchestra.run.smithi154.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 4.0 MB/s | 4.7 MB 00:01 2024-09-05T07:38:53.323 INFO:teuthology.orchestra.run.smithi175.stdout:(40/154): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-05T07:38:53.364 INFO:teuthology.orchestra.run.smithi175.stdout:(41/154): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-05T07:38:53.423 INFO:teuthology.orchestra.run.smithi175.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-05T07:38:53.465 INFO:teuthology.orchestra.run.smithi175.stdout:(43/154): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-05T07:38:53.490 INFO:teuthology.orchestra.run.smithi175.stdout:(44/154): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-05T07:38:53.524 INFO:teuthology.orchestra.run.smithi175.stdout:(45/154): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-05T07:38:53.549 INFO:teuthology.orchestra.run.smithi175.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-05T07:38:53.582 INFO:teuthology.orchestra.run.smithi175.stdout:(47/154): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-05T07:38:53.608 INFO:teuthology.orchestra.run.smithi175.stdout:(48/154): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-05T07:38:53.725 INFO:teuthology.orchestra.run.smithi175.stdout:(49/154): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-05T07:38:53.750 INFO:teuthology.orchestra.run.smithi175.stdout:(50/154): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-05T07:38:53.775 INFO:teuthology.orchestra.run.smithi175.stdout:(51/154): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-05T07:38:53.801 INFO:teuthology.orchestra.run.smithi175.stdout:(52/154): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-05T07:38:53.826 INFO:teuthology.orchestra.run.smithi175.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-05T07:38:53.868 INFO:teuthology.orchestra.run.smithi175.stdout:(54/154): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-05T07:38:53.893 INFO:teuthology.orchestra.run.smithi175.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-05T07:38:53.918 INFO:teuthology.orchestra.run.smithi175.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-05T07:38:53.943 INFO:teuthology.orchestra.run.smithi175.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-05T07:38:53.969 INFO:teuthology.orchestra.run.smithi175.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-05T07:38:54.020 INFO:teuthology.orchestra.run.smithi175.stdout:(59/154): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-05T07:38:54.086 INFO:teuthology.orchestra.run.smithi175.stdout:(60/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-05T07:38:54.111 INFO:teuthology.orchestra.run.smithi175.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 268 kB/s | 24 kB 00:00 2024-09-05T07:38:54.137 INFO:teuthology.orchestra.run.smithi175.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-05T07:38:54.162 INFO:teuthology.orchestra.run.smithi175.stdout:(63/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-05T07:38:54.187 INFO:teuthology.orchestra.run.smithi175.stdout:(64/154): libtool-2.4.6-46.el9.x86_64.rpm 2.6 MB/s | 581 kB 00:00 2024-09-05T07:38:54.212 INFO:teuthology.orchestra.run.smithi175.stdout:(65/154): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-05T07:38:54.238 INFO:teuthology.orchestra.run.smithi175.stdout:(66/154): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-05T07:38:54.296 INFO:teuthology.orchestra.run.smithi175.stdout:(67/154): postgresql-13.16-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-05T07:38:54.372 INFO:teuthology.orchestra.run.smithi175.stdout:(68/154): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-05T07:38:54.430 INFO:teuthology.orchestra.run.smithi175.stdout:(69/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-05T07:38:54.447 INFO:teuthology.orchestra.run.smithi175.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-05T07:38:54.489 INFO:teuthology.orchestra.run.smithi175.stdout:(71/154): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-05T07:38:54.522 INFO:teuthology.orchestra.run.smithi175.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-05T07:38:54.548 INFO:teuthology.orchestra.run.smithi175.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-05T07:38:54.590 INFO:teuthology.orchestra.run.smithi175.stdout:(74/154): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-05T07:38:54.665 INFO:teuthology.orchestra.run.smithi175.stdout:(75/154): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-05T07:38:54.690 INFO:teuthology.orchestra.run.smithi175.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-05T07:38:54.716 INFO:teuthology.orchestra.run.smithi175.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-05T07:38:54.719 INFO:teuthology.orchestra.run.smithi154.stdout:(8/154): ceph-common-19.1.1-259.g91c8a7e5.el9.x 4.2 MB/s | 21 MB 00:05 2024-09-05T07:38:54.741 INFO:teuthology.orchestra.run.smithi175.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-05T07:38:54.766 INFO:teuthology.orchestra.run.smithi175.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-05T07:38:54.769 INFO:teuthology.orchestra.run.smithi154.stdout:(9/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9. 507 kB/s | 25 kB 00:00 2024-09-05T07:38:54.791 INFO:teuthology.orchestra.run.smithi175.stdout:(80/154): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-05T07:38:54.816 INFO:teuthology.orchestra.run.smithi175.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-05T07:38:54.900 INFO:teuthology.orchestra.run.smithi175.stdout:(82/154): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-05T07:38:54.917 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:54.918 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:38:54.925 INFO:teuthology.orchestra.run.smithi175.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-05T07:38:54.930 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T07:38:54.931 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T07:38:54.932 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T07:38:54.933 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T07:38:54.934 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T07:38:54.936 INFO:teuthology.orchestra.run.smithi154.stdout:(10/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 6.3 MB/s | 11 MB 00:01 2024-09-05T07:38:54.937 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T07:38:54.938 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T07:38:54.976 INFO:teuthology.orchestra.run.smithi175.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-05T07:38:55.001 INFO:teuthology.orchestra.run.smithi175.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-05T07:38:55.002 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-05T07:38:55.003 INFO:teuthology.orchestra.run.smithi154.stdout:(11/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 3.3 MB/s | 224 kB 00:00 2024-09-05T07:38:55.026 INFO:teuthology.orchestra.run.smithi175.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:38:55.028 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T07:38:55.029 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T07:38:55.030 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T07:38:55.031 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T07:38:55.032 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T07:38:55.033 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T07:38:55.034 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T07:38:55.035 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T07:38:55.036 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T07:38:55.037 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T07:38:55.038 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T07:38:55.039 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-05T07:38:55.040 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-05T07:38:55.041 INFO:teuthology.orchestra.run.smithi144.stdout:Install 148 Packages 2024-09-05T07:38:55.041 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 6 Packages 2024-09-05T07:38:55.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:38:55.041 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 222 M 2024-09-05T07:38:55.041 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-05T07:38:55.044 INFO:teuthology.orchestra.run.smithi154.stdout:(12/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 653 kB/s | 27 kB 00:00 2024-09-05T07:38:55.051 INFO:teuthology.orchestra.run.smithi175.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-05T07:38:55.077 INFO:teuthology.orchestra.run.smithi175.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-05T07:38:55.095 INFO:teuthology.orchestra.run.smithi154.stdout:(13/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 636 kB/s | 32 kB 00:00 2024-09-05T07:38:55.102 INFO:teuthology.orchestra.run.smithi175.stdout:(89/154): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-05T07:38:55.127 INFO:teuthology.orchestra.run.smithi175.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-05T07:38:55.211 INFO:teuthology.orchestra.run.smithi175.stdout:(91/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-05T07:38:55.229 INFO:teuthology.orchestra.run.smithi154.stdout:(14/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 5.5 MB/s | 752 kB 00:00 2024-09-05T07:38:55.261 INFO:teuthology.orchestra.run.smithi175.stdout:(92/154): python3-toml-0.10.2-6.el9.noarch.rpm 839 kB/s | 42 kB 00:00 2024-09-05T07:38:55.279 INFO:teuthology.orchestra.run.smithi154.stdout:(15/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 3.2 MB/s | 163 kB 00:00 2024-09-05T07:38:55.303 INFO:teuthology.orchestra.run.smithi175.stdout:(93/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-05T07:38:55.329 INFO:teuthology.orchestra.run.smithi154.stdout:(16/154): librados-devel-19.1.1-259.g91c8a7e5.e 2.5 MB/s | 127 kB 00:00 2024-09-05T07:38:55.344 INFO:teuthology.orchestra.run.smithi175.stdout:(94/154): python3-requests-oauthlib-1.3.0-12.el 222 kB/s | 54 kB 00:00 2024-09-05T07:38:55.370 INFO:teuthology.orchestra.run.smithi175.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-05T07:38:55.395 INFO:teuthology.orchestra.run.smithi175.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-05T07:38:55.420 INFO:teuthology.orchestra.run.smithi175.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-05T07:38:55.445 INFO:teuthology.orchestra.run.smithi175.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-05T07:38:55.471 INFO:teuthology.orchestra.run.smithi175.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-05T07:38:55.496 INFO:teuthology.orchestra.run.smithi175.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-05T07:38:55.521 INFO:teuthology.orchestra.run.smithi175.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-05T07:38:55.521 INFO:teuthology.orchestra.run.smithi154.stdout:(17/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 5.5 MB/s | 17 MB 00:03 2024-09-05T07:38:55.546 INFO:teuthology.orchestra.run.smithi175.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-05T07:38:55.547 INFO:teuthology.orchestra.run.smithi144.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 45 kB/s | 6.6 kB 00:00 2024-09-05T07:38:55.563 INFO:teuthology.orchestra.run.smithi154.stdout:(18/154): libradosstriper1-19.1.1-259.g91c8a7e5 2.1 MB/s | 506 kB 00:00 2024-09-05T07:38:55.605 INFO:teuthology.orchestra.run.smithi154.stdout:(19/154): python3-ceph-argparse-19.1.1-259.g91c 1.1 MB/s | 45 kB 00:00 2024-09-05T07:38:55.655 INFO:teuthology.orchestra.run.smithi154.stdout:(20/154): python3-ceph-common-19.1.1-259.g91c8a 2.7 MB/s | 136 kB 00:00 2024-09-05T07:38:55.730 INFO:teuthology.orchestra.run.smithi154.stdout:(21/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 2.1 MB/s | 162 kB 00:00 2024-09-05T07:38:55.738 INFO:teuthology.orchestra.run.smithi175.stdout:(103/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-05T07:38:55.756 INFO:teuthology.orchestra.run.smithi144.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-05T07:38:55.789 INFO:teuthology.orchestra.run.smithi175.stdout:(104/154): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-05T07:38:55.822 INFO:teuthology.orchestra.run.smithi175.stdout:(105/154): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-05T07:38:55.847 INFO:teuthology.orchestra.run.smithi175.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 857 kB/s | 19 kB 00:00 2024-09-05T07:38:55.864 INFO:teuthology.orchestra.run.smithi154.stdout:(22/154): python3-rados-19.1.1-259.g91c8a7e5.el 2.4 MB/s | 321 kB 00:00 2024-09-05T07:38:55.881 INFO:teuthology.orchestra.run.smithi175.stdout:(107/154): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-05T07:38:55.881 INFO:teuthology.orchestra.run.smithi144.stdout:(3/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-05T07:38:55.906 INFO:teuthology.orchestra.run.smithi144.stdout:(4/154): ceph-immutable-object-cache-19.1.1-259 969 kB/s | 145 kB 00:00 2024-09-05T07:38:55.915 INFO:teuthology.orchestra.run.smithi175.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 773 kB/s | 26 kB 00:00 2024-09-05T07:38:55.940 INFO:teuthology.orchestra.run.smithi175.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T07:38:55.965 INFO:teuthology.orchestra.run.smithi175.stdout:(110/154): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-05T07:38:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:(23/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 2.3 MB/s | 301 kB 00:00 2024-09-05T07:38:55.999 INFO:teuthology.orchestra.run.smithi175.stdout:(111/154): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-05T07:38:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:(24/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.5 MB/s | 99 kB 00:00 2024-09-05T07:38:56.057 INFO:teuthology.orchestra.run.smithi144.stdout:(5/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 14 MB/s | 2.4 MB 00:00 2024-09-05T07:38:56.058 INFO:teuthology.orchestra.run.smithi175.stdout:(112/154): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-05T07:38:56.100 INFO:teuthology.orchestra.run.smithi175.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-05T07:38:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:(25/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-05T07:38:56.125 INFO:teuthology.orchestra.run.smithi175.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-05T07:38:56.150 INFO:teuthology.orchestra.run.smithi175.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-05T07:38:56.175 INFO:teuthology.orchestra.run.smithi175.stdout:(116/154): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-05T07:38:56.182 INFO:teuthology.orchestra.run.smithi144.stdout:(6/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 5.5 MB/s | 1.5 MB 00:00 2024-09-05T07:38:56.200 INFO:teuthology.orchestra.run.smithi175.stdout:(117/154): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-05T07:38:56.226 INFO:teuthology.orchestra.run.smithi175.stdout:(118/154): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-05T07:38:56.259 INFO:teuthology.orchestra.run.smithi175.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-05T07:38:56.326 INFO:teuthology.orchestra.run.smithi175.stdout:(120/154): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-05T07:38:56.341 INFO:teuthology.orchestra.run.smithi144.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-05T07:38:56.351 INFO:teuthology.orchestra.run.smithi175.stdout:(121/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-05T07:38:56.377 INFO:teuthology.orchestra.run.smithi175.stdout:(122/154): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-05T07:38:56.393 INFO:teuthology.orchestra.run.smithi175.stdout:(123/154): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-05T07:38:56.419 INFO:teuthology.orchestra.run.smithi175.stdout:(124/154): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-05T07:38:56.444 INFO:teuthology.orchestra.run.smithi175.stdout:(125/154): python3-jaraco-classes-3.2.1-5.el9.n 719 kB/s | 18 kB 00:00 2024-09-05T07:38:56.469 INFO:teuthology.orchestra.run.smithi175.stdout:(126/154): python3-jaraco-collections-3.0.0-8.e 465 kB/s | 23 kB 00:00 2024-09-05T07:38:56.495 INFO:teuthology.orchestra.run.smithi175.stdout:(127/154): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-05T07:38:56.520 INFO:teuthology.orchestra.run.smithi175.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-05T07:38:56.545 INFO:teuthology.orchestra.run.smithi175.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T07:38:56.570 INFO:teuthology.orchestra.run.smithi175.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T07:38:56.595 INFO:teuthology.orchestra.run.smithi175.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T07:38:56.629 INFO:teuthology.orchestra.run.smithi175.stdout:(132/154): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T07:38:56.663 INFO:teuthology.orchestra.run.smithi175.stdout:(133/154): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-05T07:38:56.688 INFO:teuthology.orchestra.run.smithi175.stdout:(134/154): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-05T07:38:56.738 INFO:teuthology.orchestra.run.smithi175.stdout:(135/154): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-05T07:38:56.764 INFO:teuthology.orchestra.run.smithi175.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-09-05T07:38:56.790 INFO:teuthology.orchestra.run.smithi175.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-05T07:38:56.814 INFO:teuthology.orchestra.run.smithi175.stdout:(138/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 596 kB/s | 90 kB 00:00 2024-09-05T07:38:56.839 INFO:teuthology.orchestra.run.smithi175.stdout:(139/154): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-05T07:38:56.861 INFO:teuthology.orchestra.run.smithi144.stdout:(8/154): ceph-common-19.1.1-259.g91c8a7e5.el9.x 15 MB/s | 21 MB 00:01 2024-09-05T07:38:56.865 INFO:teuthology.orchestra.run.smithi175.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-05T07:38:56.890 INFO:teuthology.orchestra.run.smithi175.stdout:(141/154): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-05T07:38:56.899 INFO:teuthology.orchestra.run.smithi154.stdout:(26/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 3.9 MB/s | 5.3 MB 00:01 2024-09-05T07:38:56.915 INFO:teuthology.orchestra.run.smithi175.stdout:(142/154): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-05T07:38:56.940 INFO:teuthology.orchestra.run.smithi175.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-05T07:38:56.958 INFO:teuthology.orchestra.run.smithi144.stdout:(9/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9. 259 kB/s | 25 kB 00:00 2024-09-05T07:38:56.966 INFO:teuthology.orchestra.run.smithi154.stdout:(27/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 3.6 MB/s | 3.1 MB 00:00 2024-09-05T07:38:56.966 INFO:teuthology.orchestra.run.smithi175.stdout:(144/154): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-05T07:38:56.991 INFO:teuthology.orchestra.run.smithi175.stdout:(145/154): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-05T07:38:57.016 INFO:teuthology.orchestra.run.smithi175.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-05T07:38:57.024 INFO:teuthology.orchestra.run.smithi154.stdout:(28/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 1.3 MB/s | 170 kB 00:00 2024-09-05T07:38:57.041 INFO:teuthology.orchestra.run.smithi175.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-05T07:38:57.049 INFO:teuthology.orchestra.run.smithi154.stdout:(29/154): ceph-grafana-dashboards-19.1.1-259.g9 382 kB/s | 32 kB 00:00 2024-09-05T07:38:57.075 INFO:teuthology.orchestra.run.smithi154.stdout:(30/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.9 MB/s | 146 kB 00:00 2024-09-05T07:38:57.092 INFO:teuthology.orchestra.run.smithi175.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-05T07:38:57.125 INFO:teuthology.orchestra.run.smithi144.stdout:(10/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 14 MB/s | 11 MB 00:00 2024-09-05T07:38:57.201 INFO:teuthology.orchestra.run.smithi144.stdout:(11/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 2.9 MB/s | 224 kB 00:00 2024-09-05T07:38:57.226 INFO:teuthology.orchestra.run.smithi175.stdout:(149/154): NetworkManager-1.48.10-1.el9.x86_64. 18 MB/s | 2.3 MB 00:00 2024-09-05T07:38:57.301 INFO:teuthology.orchestra.run.smithi144.stdout:(12/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 271 kB/s | 27 kB 00:00 2024-09-05T07:38:57.301 INFO:teuthology.orchestra.run.smithi175.stdout:(150/154): NetworkManager-libnm-1.48.10-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-05T07:38:57.334 INFO:teuthology.orchestra.run.smithi175.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 1.2 MB/s | 40 kB 00:00 2024-09-05T07:38:57.384 INFO:teuthology.orchestra.run.smithi175.stdout:(152/154): NetworkManager-tui-1.48.10-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-09-05T07:38:57.417 INFO:teuthology.orchestra.run.smithi144.stdout:(13/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 273 kB/s | 32 kB 00:00 2024-09-05T07:38:57.468 INFO:teuthology.orchestra.run.smithi175.stdout:(153/154): librados2-19.1.1-259.g91c8a7e5.el9.x 7.6 MB/s | 3.4 MB 00:00 2024-09-05T07:38:57.593 INFO:teuthology.orchestra.run.smithi144.stdout:(14/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 12 MB/s | 17 MB 00:01 2024-09-05T07:38:57.635 INFO:teuthology.orchestra.run.smithi144.stdout:(15/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 3.4 MB/s | 752 kB 00:00 2024-09-05T07:38:57.660 INFO:teuthology.orchestra.run.smithi144.stdout:(16/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 2.4 MB/s | 163 kB 00:00 2024-09-05T07:38:57.685 INFO:teuthology.orchestra.run.smithi144.stdout:(17/154): librados-devel-19.1.1-259.g91c8a7e5.e 2.5 MB/s | 127 kB 00:00 2024-09-05T07:38:57.727 INFO:teuthology.orchestra.run.smithi144.stdout:(18/154): libradosstriper1-19.1.1-259.g91c8a7e5 7.4 MB/s | 506 kB 00:00 2024-09-05T07:38:57.822 INFO:teuthology.orchestra.run.smithi144.stdout:(19/154): python3-ceph-argparse-19.1.1-259.g91c 477 kB/s | 45 kB 00:00 2024-09-05T07:38:57.883 INFO:teuthology.orchestra.run.smithi154.stdout:(31/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 4.3 MB/s | 3.6 MB 00:00 2024-09-05T07:38:57.903 INFO:teuthology.orchestra.run.smithi144.stdout:(20/154): python3-ceph-common-19.1.1-259.g91c8a 1.6 MB/s | 136 kB 00:00 2024-09-05T07:38:58.000 INFO:teuthology.orchestra.run.smithi154.stdout:(32/154): ceph-mgr-modules-core-19.1.1-259.g91c 2.1 MB/s | 249 kB 00:00 2024-09-05T07:38:58.003 INFO:teuthology.orchestra.run.smithi144.stdout:(21/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-05T07:38:58.037 INFO:teuthology.orchestra.run.smithi144.stdout:(22/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 1.2 MB/s | 162 kB 00:00 2024-09-05T07:38:58.050 INFO:teuthology.orchestra.run.smithi154.stdout:(33/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 989 kB/s | 49 kB 00:00 2024-09-05T07:38:58.071 INFO:teuthology.orchestra.run.smithi144.stdout:(23/154): python3-rados-19.1.1-259.g91c8a7e5.el 4.7 MB/s | 321 kB 00:00 2024-09-05T07:38:58.096 INFO:teuthology.orchestra.run.smithi144.stdout:(24/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 5.0 MB/s | 301 kB 00:00 2024-09-05T07:38:58.101 INFO:teuthology.orchestra.run.smithi154.stdout:(34/154): ceph-prometheus-alerts-19.1.1-259.g91 329 kB/s | 16 kB 00:00 2024-09-05T07:38:58.121 INFO:teuthology.orchestra.run.smithi144.stdout:(25/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.9 MB/s | 99 kB 00:00 2024-09-05T07:38:58.146 INFO:teuthology.orchestra.run.smithi144.stdout:(26/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-05T07:38:58.184 INFO:teuthology.orchestra.run.smithi154.stdout:(35/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 3.3 MB/s | 285 kB 00:00 2024-09-05T07:38:58.193 INFO:teuthology.orchestra.run.smithi175.stdout:(154/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 2.7 MB/s | 3.2 MB 00:01 2024-09-05T07:38:58.200 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:38:58.200 INFO:teuthology.orchestra.run.smithi175.stdout:Total 24 MB/s | 222 MB 00:09 2024-09-05T07:38:58.205 INFO:teuthology.orchestra.run.smithi144.stdout:(27/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-05T07:38:58.314 INFO:teuthology.orchestra.run.smithi144.stdout:(28/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-05T07:38:58.356 INFO:teuthology.orchestra.run.smithi144.stdout:(29/154): ceph-grafana-dashboards-19.1.1-259.g9 212 kB/s | 32 kB 00:00 2024-09-05T07:38:58.381 INFO:teuthology.orchestra.run.smithi144.stdout:(30/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.1 MB/s | 146 kB 00:00 2024-09-05T07:38:58.385 INFO:teuthology.orchestra.run.smithi154.stdout:(36/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 3.7 MB/s | 765 kB 00:00 2024-09-05T07:38:58.477 INFO:teuthology.orchestra.run.smithi154.stdout:(37/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 199 kB/s | 18 kB 00:00 2024-09-05T07:38:58.606 INFO:teuthology.orchestra.run.smithi144.stdout:(31/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 14 MB/s | 3.6 MB 00:00 2024-09-05T07:38:58.643 INFO:teuthology.orchestra.run.smithi154.stdout:(38/154): fuse-2.9.9-16.el9.x86_64.rpm 480 kB/s | 80 kB 00:00 2024-09-05T07:38:58.716 INFO:teuthology.orchestra.run.smithi144.stdout:(32/154): ceph-mgr-modules-core-19.1.1-259.g91c 2.2 MB/s | 249 kB 00:00 2024-09-05T07:38:58.794 INFO:teuthology.orchestra.run.smithi154.stdout:(39/154): ceph-mgr-diskprediction-local-19.1.1- 4.3 MB/s | 7.4 MB 00:01 2024-09-05T07:38:58.815 INFO:teuthology.orchestra.run.smithi144.stdout:(33/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 499 kB/s | 49 kB 00:00 2024-09-05T07:38:58.886 INFO:teuthology.orchestra.run.smithi154.stdout:(40/154): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-05T07:38:58.907 INFO:teuthology.orchestra.run.smithi144.stdout:(34/154): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-05T07:38:58.944 INFO:teuthology.orchestra.run.smithi154.stdout:(41/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-05T07:38:58.949 INFO:teuthology.orchestra.run.smithi144.stdout:(35/154): ceph-prometheus-alerts-19.1.1-259.g91 123 kB/s | 16 kB 00:00 2024-09-05T07:38:58.975 INFO:teuthology.orchestra.run.smithi144.stdout:(36/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 4.2 MB/s | 285 kB 00:00 2024-09-05T07:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout:(37/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 11 MB/s | 765 kB 00:00 2024-09-05T07:38:59.028 INFO:teuthology.orchestra.run.smithi154.stdout:(42/154): libquadmath-11.5.0-2.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-05T07:38:59.058 INFO:teuthology.orchestra.run.smithi144.stdout:(38/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 218 kB/s | 18 kB 00:00 2024-09-05T07:38:59.070 INFO:teuthology.orchestra.run.smithi154.stdout:(43/154): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-05T07:38:59.095 INFO:teuthology.orchestra.run.smithi154.stdout:(44/154): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-05T07:38:59.129 INFO:teuthology.orchestra.run.smithi154.stdout:(45/154): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-05T07:38:59.154 INFO:teuthology.orchestra.run.smithi154.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-05T07:38:59.188 INFO:teuthology.orchestra.run.smithi154.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-05T07:38:59.362 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-05T07:38:59.463 INFO:teuthology.orchestra.run.smithi154.stdout:(48/154): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-05T07:38:59.494 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-05T07:38:59.495 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-05T07:38:59.530 INFO:teuthology.orchestra.run.smithi154.stdout:(49/154): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-05T07:38:59.555 INFO:teuthology.orchestra.run.smithi154.stdout:(50/154): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-05T07:38:59.572 INFO:teuthology.orchestra.run.smithi154.stdout:(51/154): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-05T07:38:59.623 INFO:teuthology.orchestra.run.smithi154.stdout:(52/154): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-05T07:38:59.625 INFO:teuthology.orchestra.run.smithi144.stdout:(39/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 18 MB/s | 49 MB 00:02 2024-09-05T07:38:59.640 INFO:teuthology.orchestra.run.smithi154.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-05T07:38:59.651 INFO:teuthology.orchestra.run.smithi144.stdout:(40/154): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-05T07:38:59.682 INFO:teuthology.orchestra.run.smithi154.stdout:(54/154): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-05T07:38:59.723 INFO:teuthology.orchestra.run.smithi154.stdout:(55/154): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-05T07:38:59.791 INFO:teuthology.orchestra.run.smithi154.stdout:(56/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-05T07:38:59.841 INFO:teuthology.orchestra.run.smithi154.stdout:(57/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-09-05T07:38:59.908 INFO:teuthology.orchestra.run.smithi154.stdout:(58/154): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-05T07:38:59.966 INFO:teuthology.orchestra.run.smithi154.stdout:(59/154): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-05T07:39:00.017 INFO:teuthology.orchestra.run.smithi154.stdout:(60/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-05T07:39:00.068 INFO:teuthology.orchestra.run.smithi144.stdout:(41/154): libgfortran-11.5.0-2.el9.x86_64.rpm 794 kB/s | 801 kB 00:01 2024-09-05T07:39:00.075 INFO:teuthology.orchestra.run.smithi154.stdout:(61/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-05T07:39:00.093 INFO:teuthology.orchestra.run.smithi144.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 573 kB/s | 253 kB 00:00 2024-09-05T07:39:00.135 INFO:teuthology.orchestra.run.smithi144.stdout:(43/154): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-09-05T07:39:00.142 INFO:teuthology.orchestra.run.smithi154.stdout:(62/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-05T07:39:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:(44/154): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-05T07:39:00.201 INFO:teuthology.orchestra.run.smithi154.stdout:(63/154): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-05T07:39:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:(45/154): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-05T07:39:00.259 INFO:teuthology.orchestra.run.smithi154.stdout:(64/154): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-05T07:39:00.311 INFO:teuthology.orchestra.run.smithi144.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-05T07:39:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-05T07:39:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:(48/154): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-05T07:39:00.427 INFO:teuthology.orchestra.run.smithi154.stdout:(65/154): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-05T07:39:00.504 INFO:teuthology.orchestra.run.smithi144.stdout:(49/154): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-05T07:39:00.537 INFO:teuthology.orchestra.run.smithi144.stdout:(50/154): boost-program-options-1.75.0-8.el9.x8 674 kB/s | 107 kB 00:00 2024-09-05T07:39:00.571 INFO:teuthology.orchestra.run.smithi144.stdout:(51/154): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-05T07:39:00.577 INFO:teuthology.orchestra.run.smithi154.stdout:(66/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-09-05T07:39:00.621 INFO:teuthology.orchestra.run.smithi144.stdout:(52/154): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-05T07:39:00.669 INFO:teuthology.orchestra.run.smithi154.stdout:(67/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-05T07:39:00.671 INFO:teuthology.orchestra.run.smithi144.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-05T07:39:00.697 INFO:teuthology.orchestra.run.smithi144.stdout:(54/154): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-05T07:39:00.711 INFO:teuthology.orchestra.run.smithi154.stdout:(68/154): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-05T07:39:00.769 INFO:teuthology.orchestra.run.smithi154.stdout:(69/154): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-05T07:39:00.780 INFO:teuthology.orchestra.run.smithi144.stdout:(55/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-05T07:39:00.830 INFO:teuthology.orchestra.run.smithi144.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2024-09-05T07:39:00.881 INFO:teuthology.orchestra.run.smithi144.stdout:(57/154): flexiblas-openblas-openmp-3.0.4-8.el9 87 kB/s | 18 kB 00:00 2024-09-05T07:39:00.931 INFO:teuthology.orchestra.run.smithi144.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-05T07:39:00.945 INFO:teuthology.orchestra.run.smithi154.stdout:(70/154): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-05T07:39:00.956 INFO:teuthology.orchestra.run.smithi144.stdout:(59/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 913 kB/s | 160 kB 00:00 2024-09-05T07:39:00.990 INFO:teuthology.orchestra.run.smithi144.stdout:(60/154): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-05T07:39:01.029 INFO:teuthology.orchestra.run.smithi154.stdout:(71/154): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-05T07:39:01.040 INFO:teuthology.orchestra.run.smithi144.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-05T07:39:01.079 INFO:teuthology.orchestra.run.smithi154.stdout:(72/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-05T07:39:01.091 INFO:teuthology.orchestra.run.smithi144.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-05T07:39:01.116 INFO:teuthology.orchestra.run.smithi144.stdout:(63/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-05T07:39:01.141 INFO:teuthology.orchestra.run.smithi144.stdout:(64/154): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-05T07:39:01.167 INFO:teuthology.orchestra.run.smithi144.stdout:(65/154): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-05T07:39:01.209 INFO:teuthology.orchestra.run.smithi144.stdout:(66/154): openblas-0.3.26-2.el9.x86_64.rpm 417 kB/s | 38 kB 00:00 2024-09-05T07:39:01.239 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-05T07:39:01.239 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-05T07:39:01.325 INFO:teuthology.orchestra.run.smithi144.stdout:(67/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-05T07:39:01.417 INFO:teuthology.orchestra.run.smithi144.stdout:(68/154): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-05T07:39:01.459 INFO:teuthology.orchestra.run.smithi144.stdout:(69/154): postgresql-13.16-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-05T07:39:01.485 INFO:teuthology.orchestra.run.smithi144.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-05T07:39:01.518 INFO:teuthology.orchestra.run.smithi144.stdout:(71/154): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-05T07:39:01.546 INFO:teuthology.orchestra.run.smithi154.stdout:(73/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 7.2 MB/s | 49 MB 00:06 2024-09-05T07:39:01.560 INFO:teuthology.orchestra.run.smithi144.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-05T07:39:01.586 INFO:teuthology.orchestra.run.smithi144.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-05T07:39:01.651 INFO:teuthology.orchestra.run.smithi154.stdout:(74/154): postgresql-contrib-13.16-1.el9.x86_64 990 kB/s | 910 kB 00:00 2024-09-05T07:39:01.651 INFO:teuthology.orchestra.run.smithi154.stdout:(75/154): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-05T07:39:01.677 INFO:teuthology.orchestra.run.smithi144.stdout:(74/154): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-05T07:39:01.719 INFO:teuthology.orchestra.run.smithi144.stdout:(75/154): python3-colorama-0.4.6-3.el9.noarch.r 458 kB/s | 61 kB 00:00 2024-09-05T07:39:01.722 INFO:teuthology.orchestra.run.smithi154.stdout:(76/154): python3-babel-2.9.1-2.el9.noarch.rpm 9.3 MB/s | 6.0 MB 00:00 2024-09-05T07:39:01.745 INFO:teuthology.orchestra.run.smithi144.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-05T07:39:01.747 INFO:teuthology.orchestra.run.smithi154.stdout:(77/154): python3-colorama-0.4.6-3.el9.noarch.r 305 kB/s | 61 kB 00:00 2024-09-05T07:39:01.773 INFO:teuthology.orchestra.run.smithi154.stdout:(78/154): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-05T07:39:01.778 INFO:teuthology.orchestra.run.smithi144.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-05T07:39:01.798 INFO:teuthology.orchestra.run.smithi154.stdout:(79/154): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-05T07:39:01.823 INFO:teuthology.orchestra.run.smithi154.stdout:(80/154): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-05T07:39:01.829 INFO:teuthology.orchestra.run.smithi144.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-05T07:39:01.849 INFO:teuthology.orchestra.run.smithi154.stdout:(81/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-05T07:39:01.866 INFO:teuthology.orchestra.run.smithi154.stdout:(82/154): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-09-05T07:39:01.870 INFO:teuthology.orchestra.run.smithi144.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 208 kB/s | 19 kB 00:00 2024-09-05T07:39:01.907 INFO:teuthology.orchestra.run.smithi154.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-05T07:39:01.933 INFO:teuthology.orchestra.run.smithi154.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-05T07:39:01.958 INFO:teuthology.orchestra.run.smithi154.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-05T07:39:01.962 INFO:teuthology.orchestra.run.smithi144.stdout:(80/154): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-05T07:39:01.975 INFO:teuthology.orchestra.run.smithi154.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-05T07:39:02.005 INFO:teuthology.orchestra.run.smithi144.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 260 kB/s | 35 kB 00:00 2024-09-05T07:39:02.017 INFO:teuthology.orchestra.run.smithi154.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-05T07:39:02.030 INFO:teuthology.orchestra.run.smithi144.stdout:(82/154): python3-mako-1.1.4-6.el9.noarch.rpm 857 kB/s | 172 kB 00:00 2024-09-05T07:39:02.042 INFO:teuthology.orchestra.run.smithi154.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-05T07:39:02.072 INFO:teuthology.orchestra.run.smithi144.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-05T07:39:02.075 INFO:teuthology.orchestra.run.smithi154.stdout:(89/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-05T07:39:02.097 INFO:teuthology.orchestra.run.smithi144.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-05T07:39:02.101 INFO:teuthology.orchestra.run.smithi154.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-05T07:39:02.126 INFO:teuthology.orchestra.run.smithi154.stdout:(91/154): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-05T07:39:02.131 INFO:teuthology.orchestra.run.smithi144.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-05T07:39:02.185 INFO:teuthology.orchestra.run.smithi154.stdout:(92/154): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-05T07:39:02.206 INFO:teuthology.orchestra.run.smithi144.stdout:(86/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-05T07:39:02.243 INFO:teuthology.orchestra.run.smithi154.stdout:(93/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 761 kB/s | 44 kB 00:00 2024-09-05T07:39:02.248 INFO:teuthology.orchestra.run.smithi144.stdout:(87/154): python3-prettytable-0.7.2-27.el9.noar 280 kB/s | 42 kB 00:00 2024-09-05T07:39:02.302 INFO:teuthology.orchestra.run.smithi144.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-05T07:39:02.302 INFO:teuthology.orchestra.run.smithi154.stdout:(94/154): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-05T07:39:02.361 INFO:teuthology.orchestra.run.smithi154.stdout:(95/154): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-05T07:39:02.401 INFO:teuthology.orchestra.run.smithi144.stdout:(89/154): python3-protobuf-3.14.0-13.el9.noarch 999 kB/s | 269 kB 00:00 2024-09-05T07:39:02.419 INFO:teuthology.orchestra.run.smithi154.stdout:(96/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-09-05T07:39:02.449 INFO:teuthology.orchestra.run.smithi144.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 347 kB/s | 51 kB 00:00 2024-09-05T07:39:02.491 INFO:teuthology.orchestra.run.smithi144.stdout:(91/154): python3-requests-oauthlib-1.3.0-12.el 599 kB/s | 54 kB 00:00 2024-09-05T07:39:02.516 INFO:teuthology.orchestra.run.smithi144.stdout:(92/154): python3-pyasn1-modules-0.4.8-6.el9.no 1.0 MB/s | 279 kB 00:00 2024-09-05T07:39:02.567 INFO:teuthology.orchestra.run.smithi144.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-05T07:39:02.578 INFO:teuthology.orchestra.run.smithi154.stdout:(97/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-05T07:39:02.603 INFO:teuthology.orchestra.run.smithi154.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-05T07:39:02.608 INFO:teuthology.orchestra.run.smithi144.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-09-05T07:39:02.634 INFO:teuthology.orchestra.run.smithi144.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-05T07:39:02.653 INFO:teuthology.orchestra.run.smithi154.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 772 kB/s | 58 kB 00:00 2024-09-05T07:39:02.684 INFO:teuthology.orchestra.run.smithi144.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-05T07:39:02.687 INFO:teuthology.orchestra.run.smithi154.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-05T07:39:02.712 INFO:teuthology.orchestra.run.smithi154.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-05T07:39:02.726 INFO:teuthology.orchestra.run.smithi144.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 518 kB/s | 47 kB 00:00 2024-09-05T07:39:02.737 INFO:teuthology.orchestra.run.smithi154.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-05T07:39:02.751 INFO:teuthology.orchestra.run.smithi144.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-05T07:39:02.810 INFO:teuthology.orchestra.run.smithi144.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-09-05T07:39:02.836 INFO:teuthology.orchestra.run.smithi144.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-05T07:39:02.877 INFO:teuthology.orchestra.run.smithi144.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 957 kB/s | 64 kB 00:00 2024-09-05T07:39:02.903 INFO:teuthology.orchestra.run.smithi144.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-09-05T07:39:02.995 INFO:teuthology.orchestra.run.smithi144.stdout:(103/154): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-05T07:39:03.203 INFO:teuthology.orchestra.run.smithi144.stdout:(104/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-05T07:39:03.254 INFO:teuthology.orchestra.run.smithi154.stdout:(103/154): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2024-09-05T07:39:03.270 INFO:teuthology.orchestra.run.smithi144.stdout:(105/154): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-09-05T07:39:03.295 INFO:teuthology.orchestra.run.smithi144.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-05T07:39:03.305 INFO:teuthology.orchestra.run.smithi154.stdout:(104/154): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-05T07:39:03.329 INFO:teuthology.orchestra.run.smithi144.stdout:(107/154): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-05T07:39:03.346 INFO:teuthology.orchestra.run.smithi154.stdout:(105/154): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-05T07:39:03.354 INFO:teuthology.orchestra.run.smithi144.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-05T07:39:03.372 INFO:teuthology.orchestra.run.smithi154.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-05T07:39:03.396 INFO:teuthology.orchestra.run.smithi144.stdout:(109/154): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-05T07:39:03.422 INFO:teuthology.orchestra.run.smithi144.stdout:(110/154): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-09-05T07:39:03.463 INFO:teuthology.orchestra.run.smithi144.stdout:(111/154): luarocks-3.9.2-5.el9.noarch.rpm 4.9 MB/s | 151 kB 00:00 2024-09-05T07:39:03.472 INFO:teuthology.orchestra.run.smithi154.stdout:(107/154): python3-numpy-1.20.1-5.el9.x86_64.rp 3.1 MB/s | 5.1 MB 00:01 2024-09-05T07:39:03.497 INFO:teuthology.orchestra.run.smithi144.stdout:(112/154): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-05T07:39:03.522 INFO:teuthology.orchestra.run.smithi154.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-05T07:39:03.547 INFO:teuthology.orchestra.run.smithi144.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-05T07:39:03.548 INFO:teuthology.orchestra.run.smithi154.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T07:39:03.573 INFO:teuthology.orchestra.run.smithi144.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-05T07:39:03.598 INFO:teuthology.orchestra.run.smithi144.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-05T07:39:03.615 INFO:teuthology.orchestra.run.smithi154.stdout:(110/154): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-05T07:39:03.623 INFO:teuthology.orchestra.run.smithi144.stdout:(116/154): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-05T07:39:03.640 INFO:teuthology.orchestra.run.smithi154.stdout:(111/154): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-05T07:39:03.648 INFO:teuthology.orchestra.run.smithi144.stdout:(117/154): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-05T07:39:03.674 INFO:teuthology.orchestra.run.smithi154.stdout:(112/154): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-05T07:39:03.682 INFO:teuthology.orchestra.run.smithi144.stdout:(118/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-05T07:39:03.707 INFO:teuthology.orchestra.run.smithi154.stdout:(113/154): protobuf-compiler-3.14.0-13.el9.x86_ 890 kB/s | 863 kB 00:00 2024-09-05T07:39:03.724 INFO:teuthology.orchestra.run.smithi144.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-05T07:39:03.749 INFO:teuthology.orchestra.run.smithi154.stdout:(114/154): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-05T07:39:03.758 INFO:teuthology.orchestra.run.smithi144.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-05T07:39:03.774 INFO:teuthology.orchestra.run.smithi154.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-05T07:39:03.783 INFO:teuthology.orchestra.run.smithi144.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-05T07:39:03.800 INFO:teuthology.orchestra.run.smithi154.stdout:(116/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-05T07:39:03.817 INFO:teuthology.orchestra.run.smithi144.stdout:(122/154): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-05T07:39:03.825 INFO:teuthology.orchestra.run.smithi154.stdout:(117/154): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-05T07:39:03.842 INFO:teuthology.orchestra.run.smithi144.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-05T07:39:03.859 INFO:teuthology.orchestra.run.smithi154.stdout:(118/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-05T07:39:03.867 INFO:teuthology.orchestra.run.smithi144.stdout:(124/154): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-05T07:39:03.884 INFO:teuthology.orchestra.run.smithi154.stdout:(119/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-05T07:39:03.892 INFO:teuthology.orchestra.run.smithi144.stdout:(125/154): python3-jaraco-collections-3.0.0-8.e 940 kB/s | 23 kB 00:00 2024-09-05T07:39:03.909 INFO:teuthology.orchestra.run.smithi154.stdout:(120/154): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-05T07:39:03.918 INFO:teuthology.orchestra.run.smithi144.stdout:(126/154): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-05T07:39:03.934 INFO:teuthology.orchestra.run.smithi154.stdout:(121/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-05T07:39:03.943 INFO:teuthology.orchestra.run.smithi144.stdout:(127/154): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-05T07:39:03.968 INFO:teuthology.orchestra.run.smithi154.stdout:(122/154): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-05T07:39:03.993 INFO:teuthology.orchestra.run.smithi154.stdout:(123/154): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-05T07:39:04.019 INFO:teuthology.orchestra.run.smithi154.stdout:(124/154): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-05T07:39:04.036 INFO:teuthology.orchestra.run.smithi154.stdout:(125/154): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-05T07:39:04.043 INFO:teuthology.orchestra.run.smithi144.stdout:(128/154): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-05T07:39:04.053 INFO:teuthology.orchestra.run.smithi154.stdout:(126/154): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-09-05T07:39:04.070 INFO:teuthology.orchestra.run.smithi154.stdout:(127/154): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2024-09-05T07:39:04.086 INFO:teuthology.orchestra.run.smithi154.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 588 kB/s | 20 kB 00:00 2024-09-05T07:39:04.090 INFO:teuthology.orchestra.run.smithi144.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.0 MB/s | 46 kB 00:00 2024-09-05T07:39:04.112 INFO:teuthology.orchestra.run.smithi154.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T07:39:04.119 INFO:teuthology.orchestra.run.smithi144.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 2.7 MB/s | 79 kB 00:00 2024-09-05T07:39:04.137 INFO:teuthology.orchestra.run.smithi154.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T07:39:04.144 INFO:teuthology.orchestra.run.smithi144.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T07:39:04.154 INFO:teuthology.orchestra.run.smithi154.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-05T07:39:04.178 INFO:teuthology.orchestra.run.smithi144.stdout:(132/154): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-09-05T07:39:04.188 INFO:teuthology.orchestra.run.smithi154.stdout:(132/154): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T07:39:04.204 INFO:teuthology.orchestra.run.smithi144.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-05T07:39:04.204 INFO:teuthology.orchestra.run.smithi154.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 991 kB/s | 16 kB 00:00 2024-09-05T07:39:04.238 INFO:teuthology.orchestra.run.smithi154.stdout:(134/154): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-05T07:39:04.256 INFO:teuthology.orchestra.run.smithi144.stdout:(134/154): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-09-05T07:39:04.263 INFO:teuthology.orchestra.run.smithi154.stdout:(135/154): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-05T07:39:04.281 INFO:teuthology.orchestra.run.smithi144.stdout:(135/154): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-05T07:39:04.289 INFO:teuthology.orchestra.run.smithi154.stdout:(136/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-05T07:39:04.306 INFO:teuthology.orchestra.run.smithi144.stdout:(136/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 879 kB/s | 90 kB 00:00 2024-09-05T07:39:04.314 INFO:teuthology.orchestra.run.smithi154.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-05T07:39:04.332 INFO:teuthology.orchestra.run.smithi144.stdout:(137/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-05T07:39:04.339 INFO:teuthology.orchestra.run.smithi154.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T07:39:04.357 INFO:teuthology.orchestra.run.smithi144.stdout:(138/154): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-09-05T07:39:04.365 INFO:teuthology.orchestra.run.smithi154.stdout:(139/154): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-05T07:39:04.382 INFO:teuthology.orchestra.run.smithi144.stdout:(139/154): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-05T07:39:04.390 INFO:teuthology.orchestra.run.smithi154.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-05T07:39:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-05T07:39:04.432 INFO:teuthology.orchestra.run.smithi154.stdout:(141/154): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-05T07:39:04.433 INFO:teuthology.orchestra.run.smithi144.stdout:(141/154): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-05T07:39:04.458 INFO:teuthology.orchestra.run.smithi154.stdout:(142/154): python3-typing-extensions-4.12.2-2.e 805 kB/s | 74 kB 00:00 2024-09-05T07:39:04.458 INFO:teuthology.orchestra.run.smithi144.stdout:(142/154): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-05T07:39:04.483 INFO:teuthology.orchestra.run.smithi154.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-05T07:39:04.484 INFO:teuthology.orchestra.run.smithi144.stdout:(143/154): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-05T07:39:04.508 INFO:teuthology.orchestra.run.smithi154.stdout:(144/154): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-05T07:39:04.509 INFO:teuthology.orchestra.run.smithi144.stdout:(144/154): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-05T07:39:04.534 INFO:teuthology.orchestra.run.smithi144.stdout:(145/154): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-05T07:39:04.550 INFO:teuthology.orchestra.run.smithi154.stdout:(145/154): python3-webob-1.8.8-2.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-09-05T07:39:04.559 INFO:teuthology.orchestra.run.smithi144.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-05T07:39:04.575 INFO:teuthology.orchestra.run.smithi154.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-05T07:39:04.584 INFO:teuthology.orchestra.run.smithi144.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-05T07:39:04.609 INFO:teuthology.orchestra.run.smithi154.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-05T07:39:04.635 INFO:teuthology.orchestra.run.smithi144.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-05T07:39:04.659 INFO:teuthology.orchestra.run.smithi154.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-05T07:39:04.818 INFO:teuthology.orchestra.run.smithi144.stdout:(149/154): librados2-19.1.1-259.g91c8a7e5.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-05T07:39:04.943 INFO:teuthology.orchestra.run.smithi154.stdout:(149/154): NetworkManager-1.48.10-1.el9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-09-05T07:39:05.010 INFO:teuthology.orchestra.run.smithi144.stdout:(150/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-05T07:39:05.051 INFO:teuthology.orchestra.run.smithi154.stdout:(150/154): NetworkManager-libnm-1.48.10-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-09-05T07:39:05.110 INFO:teuthology.orchestra.run.smithi154.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 697 kB/s | 40 kB 00:00 2024-09-05T07:39:05.177 INFO:teuthology.orchestra.run.smithi154.stdout:(152/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 5.6 MB/s | 3.2 MB 00:00 2024-09-05T07:39:05.210 INFO:teuthology.orchestra.run.smithi154.stdout:(153/154): NetworkManager-tui-1.48.10-1.el9.x86 2.4 MB/s | 248 kB 00:00 2024-09-05T07:39:05.277 INFO:teuthology.orchestra.run.smithi144.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 152 kB/s | 40 kB 00:00 2024-09-05T07:39:05.369 INFO:teuthology.orchestra.run.smithi154.stdout:(154/154): librados2-19.1.1-259.g91c8a7e5.el9.x 4.3 MB/s | 3.4 MB 00:00 2024-09-05T07:39:05.376 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:39:05.376 INFO:teuthology.orchestra.run.smithi154.stdout:Total 14 MB/s | 222 MB 00:16 2024-09-05T07:39:05.569 INFO:teuthology.orchestra.run.smithi144.stdout:(152/154): NetworkManager-1.48.10-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-05T07:39:05.627 INFO:teuthology.orchestra.run.smithi144.stdout:(153/154): NetworkManager-tui-1.48.10-1.el9.x86 710 kB/s | 248 kB 00:00 2024-09-05T07:39:05.694 INFO:teuthology.orchestra.run.smithi144.stdout:(154/154): NetworkManager-libnm-1.48.10-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-09-05T07:39:05.701 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:39:05.701 INFO:teuthology.orchestra.run.smithi144.stdout:Total 21 MB/s | 222 MB 00:10 2024-09-05T07:39:06.559 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-05T07:39:06.695 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-05T07:39:06.696 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-05T07:39:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-05T07:39:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T07:39:07.469 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T07:39:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T07:39:07.690 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-05T07:39:07.852 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-05T07:39:07.852 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-05T07:39:07.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T07:39:08.112 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:08.244 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:08.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:39:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T07:39:08.456 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-05T07:39:08.457 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-05T07:39:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T07:39:08.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T07:39:08.657 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T07:39:08.694 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:08.797 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:08.819 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:08.865 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:08.887 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:08.909 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:09.106 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:09.251 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:09.428 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:09.604 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:09.832 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:09.957 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T07:39:10.066 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T07:39:10.101 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T07:39:10.136 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T07:39:10.147 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-05T07:39:10.147 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-05T07:39:10.210 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T07:39:10.262 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T07:39:10.302 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T07:39:10.345 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T07:39:10.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T07:39:10.406 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T07:39:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T07:39:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T07:39:10.566 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T07:39:10.601 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T07:39:10.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T07:39:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T07:39:10.755 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:39:10.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T07:39:10.855 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T07:39:10.908 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T07:39:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T07:39:11.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T07:39:11.177 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T07:39:11.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T07:39:11.797 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T07:39:11.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T07:39:11.877 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T07:39:11.915 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T07:39:11.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T07:39:12.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T07:39:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T07:39:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T07:39:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T07:39:12.201 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T07:39:12.237 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T07:39:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T07:39:12.323 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T07:39:12.460 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T07:39:12.499 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T07:39:12.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T07:39:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T07:39:12.699 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T07:39:12.739 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T07:39:12.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T07:39:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T07:39:12.864 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T07:39:12.992 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T07:39:13.080 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T07:39:13.107 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T07:39:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T07:39:13.186 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T07:39:13.224 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T07:39:13.263 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T07:39:13.301 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T07:39:13.327 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T07:39:13.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T07:39:13.410 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T07:39:13.444 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T07:39:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T07:39:13.575 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T07:39:13.607 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T07:39:13.711 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T07:39:13.766 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T07:39:14.499 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T07:39:14.545 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T07:39:14.579 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T07:39:14.680 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T07:39:14.734 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T07:39:14.780 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T07:39:14.841 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-05T07:39:14.868 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T07:39:14.913 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T07:39:14.915 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T07:39:14.938 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T07:39:14.981 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T07:39:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T07:39:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T07:39:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T07:39:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T07:39:15.422 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:15.565 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:15.640 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:15.682 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:39:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T07:39:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T07:39:15.863 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T07:39:15.892 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T07:39:15.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T07:39:15.969 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T07:39:15.978 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:16.175 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:16.197 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:16.217 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:16.416 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:16.564 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:16.628 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-05T07:39:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:16.716 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T07:39:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T07:39:16.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T07:39:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:16.923 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:17.147 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T07:39:17.213 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T07:39:17.266 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T07:39:17.281 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T07:39:17.327 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T07:39:17.362 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T07:39:17.368 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T07:39:17.394 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T07:39:17.430 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T07:39:17.460 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T07:39:17.505 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T07:39:17.528 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:17.565 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T07:39:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T07:39:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T07:39:17.671 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:17.677 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T07:39:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T07:39:17.716 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T07:39:17.721 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:39:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:17.754 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T07:39:17.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T07:39:17.788 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T07:39:17.813 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:17.840 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T07:39:17.852 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T07:39:17.869 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T07:39:17.888 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T07:39:17.913 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T07:39:17.999 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T07:39:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T07:39:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T07:39:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:39:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T07:39:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T07:39:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:18.186 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T07:39:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T07:39:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T07:39:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:18.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T07:39:18.401 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T07:39:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T07:39:18.472 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:18.500 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T07:39:18.502 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T07:39:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T07:39:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:18.961 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T07:39:19.043 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T07:39:19.104 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:19.130 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T07:39:19.166 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T07:39:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T07:39:19.209 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T07:39:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T07:39:19.280 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T07:39:19.304 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T07:39:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T07:39:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T07:39:19.466 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T07:39:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T07:39:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T07:39:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T07:39:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T07:39:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T07:39:19.826 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T07:39:19.870 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T07:39:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T07:39:19.912 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T07:39:20.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T07:39:20.026 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T07:39:20.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T07:39:20.071 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T07:39:20.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T07:39:20.189 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T07:39:20.190 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T07:39:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T07:39:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T07:39:20.354 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T07:39:20.393 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T07:39:20.403 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T07:39:20.427 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T07:39:20.428 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T07:39:20.513 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T07:39:20.517 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T07:39:20.579 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T07:39:20.614 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T07:39:20.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T07:39:20.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T07:39:20.685 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T07:39:20.713 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T07:39:20.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T07:39:20.747 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T07:39:20.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T07:39:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T07:39:20.829 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:39:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T07:39:20.857 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T07:39:20.886 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T07:39:20.932 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T07:39:20.948 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T07:39:20.976 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T07:39:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T07:39:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T07:39:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T07:39:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T07:39:21.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T07:39:21.173 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T07:39:21.204 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T07:39:21.239 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:21.246 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T07:39:21.278 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T07:39:21.338 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T07:39:21.360 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T07:39:21.423 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T07:39:21.784 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:21.826 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:21.929 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:21.929 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T07:39:21.929 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T07:39:21.930 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:21.977 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:21.985 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T07:39:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T07:39:22.172 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T07:39:22.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T07:39:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T07:39:22.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T07:39:22.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T07:39:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T07:39:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T07:39:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T07:39:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T07:39:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T07:39:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T07:39:22.461 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T07:39:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T07:39:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T07:39:22.550 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T07:39:22.590 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T07:39:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T07:39:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T07:39:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T07:39:22.739 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T07:39:22.774 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T07:39:22.805 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T07:39:22.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T07:39:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T07:39:22.955 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T07:39:22.998 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T07:39:23.125 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T07:39:23.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T07:39:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T07:39:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T07:39:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T07:39:23.416 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T07:39:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T07:39:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T07:39:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T07:39:23.665 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T07:39:23.672 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T07:39:23.707 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T07:39:23.757 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T07:39:23.826 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T07:39:23.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T07:39:23.911 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T07:39:23.946 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T07:39:23.978 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T07:39:24.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T07:39:24.055 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T07:39:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T07:39:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T07:39:24.250 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T07:39:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T07:39:24.447 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T07:39:24.948 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T07:39:25.052 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T07:39:25.078 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T07:39:25.111 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T07:39:25.346 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T07:39:25.392 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T07:39:25.419 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T07:39:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T07:39:25.474 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:25.547 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T07:39:25.565 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:25.595 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T07:39:25.631 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T07:39:25.643 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T07:39:25.695 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T07:39:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T07:39:25.844 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T07:39:26.079 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T07:39:26.110 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T07:39:26.110 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T07:39:26.135 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T07:39:26.206 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:26.305 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T07:39:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T07:39:27.174 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T07:39:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T07:39:28.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T07:39:28.902 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T07:39:28.909 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T07:39:28.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:29.266 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T07:39:29.312 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T07:39:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T07:39:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T07:39:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:29.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:29.633 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:29.633 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T07:39:29.633 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T07:39:29.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:29.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:30.005 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T07:39:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:30.190 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T07:39:30.217 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T07:39:32.735 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:32.780 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:33.423 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T07:39:33.468 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:33.648 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T07:39:33.648 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T07:39:33.648 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T07:39:33.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:33.694 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:33.854 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:33.854 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-05T07:39:33.855 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:34.039 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:34.055 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:34.055 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T07:39:34.055 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:35.517 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:35.543 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:35.544 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:35.544 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T07:39:35.544 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:35.544 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:35.544 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:35.767 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:35.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:36.218 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:36.241 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:36.242 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:36.242 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T07:39:36.242 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:36.242 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:36.242 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:36.348 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T07:39:36.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T07:39:36.460 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T07:39:36.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T07:39:36.693 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T07:39:36.771 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T07:39:36.859 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T07:39:37.006 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T07:39:37.060 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T07:39:37.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T07:39:37.120 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T07:39:37.573 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:37.601 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:37.633 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T07:39:37.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T07:39:37.724 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:38.771 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:38.809 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:39.775 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:39.801 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:39.904 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:40.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T07:39:40.095 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:40.170 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:40.182 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:40.280 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T07:39:40.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T07:39:41.273 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T07:39:41.306 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:41.330 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:41.405 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:41.405 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T07:39:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-05T07:39:41.521 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-05T07:39:41.522 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-05T07:39:41.522 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-05T07:39:41.522 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:41.726 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:41.726 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T07:39:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:41.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:41.815 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:43.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:43.237 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:43.460 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:43.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:44.049 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T07:39:44.107 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T07:39:44.161 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T07:39:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T07:39:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T07:39:44.472 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T07:39:44.561 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T07:39:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T07:39:44.745 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T07:39:44.776 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T07:39:44.813 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T07:39:45.266 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:45.303 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:45.334 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T07:39:45.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T07:39:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:46.361 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T07:39:46.403 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T07:39:46.443 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T07:39:46.475 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T07:39:46.484 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:46.503 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T07:39:46.520 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T07:39:46.566 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-05T07:39:46.566 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-05T07:39:46.566 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-05T07:39:46.567 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-05T07:39:46.567 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-05T07:39:46.567 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-05T07:39:46.567 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-05T07:39:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:46.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T07:39:46.741 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T07:39:46.771 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T07:39:46.781 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:46.801 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T07:39:46.817 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T07:39:46.817 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:46.817 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T07:39:46.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:46.839 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T07:39:47.488 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:47.491 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:47.512 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:47.528 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:47.549 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:47.774 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T07:39:47.806 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:47.830 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:47.830 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:47.830 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T07:39:47.831 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:47.831 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:47.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:47.889 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:47.901 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T07:39:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T07:39:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T07:39:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:39:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:48.482 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T07:39:48.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T07:39:48.611 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T07:39:48.644 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T07:39:48.670 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T07:39:48.670 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:39:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:48.745 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:39:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:48.770 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T07:39:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:48.775 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:48.956 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:48.956 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:39:48.973 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T07:39:49.009 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:49.022 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:39:49.022 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:49.033 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:49.076 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:49.099 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:49.099 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:49.099 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T07:39:49.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:49.151 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:49.175 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:39:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:49.427 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T07:39:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T07:39:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:49.509 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:49.509 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T07:39:49.509 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:49.509 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:39:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T07:39:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T07:39:49.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T07:39:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T07:39:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T07:39:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T07:39:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T07:39:50.295 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T07:39:50.329 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T07:39:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T07:39:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T07:39:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T07:39:51.053 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:52.258 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T07:39:52.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T07:39:53.420 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T07:39:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T07:39:53.780 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:39:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T07:39:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T07:39:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T07:39:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T07:39:54.114 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T07:39:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T07:39:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T07:39:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T07:39:54.380 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T07:39:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T07:39:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T07:39:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T07:39:54.533 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T07:39:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:39:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:39:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T07:39:54.739 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T07:39:54.740 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T07:39:54.741 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T07:39:54.742 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T07:39:54.743 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T07:39:54.744 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T07:39:54.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T07:39:54.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T07:39:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T07:39:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T07:39:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T07:39:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T07:39:54.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T07:39:54.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T07:39:54.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T07:39:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T07:39:54.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T07:39:54.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:54.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T07:39:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T07:39:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:55.157 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T07:39:55.185 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:55.185 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T07:39:55.185 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:55.186 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:39:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:55.189 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:55.210 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:39:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T07:39:55.292 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:55.292 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T07:39:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:55.343 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:55.394 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T07:39:55.395 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:55.395 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T07:39:55.395 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:55.395 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:39:55.395 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:39:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:39:56.071 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T07:39:56.161 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T07:39:56.202 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T07:39:56.284 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T07:39:56.314 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T07:39:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T07:39:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:39:56.440 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:39:56.490 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T07:39:56.496 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:56.496 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:39:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:39:56.751 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:39:56.751 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:39:56.984 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T07:39:56.984 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:56.984 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-05T07:39:56.984 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.985 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.986 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T07:39:56.987 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T07:39:56.989 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T07:39:56.990 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T07:39:56.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T07:39:56.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T07:39:56.994 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T07:39:56.995 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T07:39:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:39:56.997 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T07:39:56.998 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T07:39:56.999 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:39:56.999 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-05T07:39:57.358 DEBUG:teuthology.parallel:result is None 2024-09-05T07:40:00.715 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T07:40:00.757 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T07:40:00.801 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T07:40:00.830 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T07:40:00.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T07:40:01.108 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T07:40:01.162 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T07:40:01.192 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T07:40:01.249 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T07:40:01.284 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T07:40:02.059 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:40:02.136 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:40:02.178 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:40:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T07:40:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T07:40:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T07:40:02.641 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T07:40:02.641 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T07:40:02.642 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T07:40:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T07:40:02.644 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T07:40:02.645 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T07:40:02.646 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T07:40:02.647 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T07:40:02.648 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T07:40:02.649 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T07:40:02.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:40:02.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T07:40:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T07:40:03.538 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T07:40:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T07:40:03.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T07:40:03.749 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T07:40:03.777 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T07:40:03.777 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:40:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T07:40:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T07:40:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:40:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:40:04.187 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:40:04.187 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:40:04.296 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T07:40:04.296 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:40:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T07:40:04.648 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-05T07:40:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:05.139 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.141 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T07:40:05.142 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.143 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.144 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T07:40:05.145 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T07:40:05.146 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.147 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T07:40:05.148 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T07:40:05.149 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T07:40:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T07:40:05.151 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T07:40:05.152 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T07:40:05.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T07:40:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T07:40:05.155 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T07:40:05.156 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T07:40:05.156 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:40:05.156 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-05T07:40:05.542 DEBUG:teuthology.parallel:result is None 2024-09-05T07:40:10.492 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T07:40:10.493 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T07:40:10.494 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T07:40:10.495 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T07:40:10.495 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T07:40:10.506 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T07:40:10.506 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T07:40:10.506 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T07:40:10.506 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T07:40:10.507 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T07:40:10.508 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T07:40:10.509 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T07:40:10.510 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T07:40:10.511 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T07:40:10.512 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T07:40:10.513 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T07:40:10.514 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T07:40:10.515 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T07:40:10.516 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T07:40:10.517 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T07:40:10.517 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T07:40:10.517 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T07:40:10.517 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T07:40:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.594 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T07:40:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T07:40:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T07:40:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T07:40:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T07:40:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T07:40:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T07:40:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T07:40:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T07:40:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T07:40:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T07:40:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T07:40:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T07:40:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:40:12.608 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-05T07:40:13.218 DEBUG:teuthology.parallel:result is None 2024-09-05T07:40:13.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:13.371 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T07:40:13.416 INFO:teuthology.orchestra.run.smithi144.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.416 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.417 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T07:40:13.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:13.553 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T07:40:13.580 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.580 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.581 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T07:40:13.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:13.723 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T07:40:13.749 INFO:teuthology.orchestra.run.smithi175.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.749 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T07:40:13.749 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T07:40:13.751 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T07:40:13.752 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:40:13.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T07:40:13.811 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:40:13.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T07:40:13.844 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:40:13.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T07:40:13.874 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T07:40:13.875 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:40:13.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T07:40:13.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T07:40:14.034 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:40:14.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T07:40:14.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T07:40:14.132 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:40:14.132 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T07:40:14.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T07:40:14.231 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T07:40:14.231 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:40:14.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T07:40:14.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T07:40:14.384 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:40:14.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T07:40:14.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T07:40:14.483 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:40:14.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T07:40:14.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T07:40:14.573 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T07:40:14.573 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:40:14.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T07:40:14.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T07:40:14.729 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:40:14.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T07:40:14.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T07:40:14.828 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:40:14.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T07:40:14.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T07:40:14.917 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-05T07:40:15.015 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'subvols': {'create': 2}} 2024-09-05T07:40:15.015 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:15.016 INFO:tasks.cephadm:Cluster fsid is 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:40:15.016 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-05T07:40:15.016 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.144', 'mon.b': '172.21.15.154', 'mon.c': '172.21.15.175'} 2024-09-05T07:40:15.016 INFO:tasks.cephadm:First mon is mon.a on smithi144 2024-09-05T07:40:15.016 INFO:tasks.cephadm:First mgr is x 2024-09-05T07:40:15.016 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-05T07:40:15.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2024-09-05T07:40:15.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-05T07:40:15.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-09-05T07:40:15.128 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-05T07:40:15.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:15.272 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56000/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-259-g91c8a7e5', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-259.g91c8a7e5'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-04 16:53:37.418684', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-05T07:40:15.409 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:40:15.411 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm 2024-09-05T07:40:15.411 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm 2024-09-05T07:40:15.411 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:15.845 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 07:40 /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:15.845 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 07:40 /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.224 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 07:40 /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.599 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.637 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.656 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T07:40:16.692 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 on all hosts... 2024-09-05T07:40:16.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T07:40:16.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T07:40:16.699 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T07:40:18.224 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T07:40:18.312 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T07:40:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T07:40:47.168 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-09-05T07:40:47.169 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-05T07:40:48.789 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-05T07:40:52.335 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:40:52.336 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:40:52.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2024-09-05T07:40:52.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-05T07:40:52.459 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-09-05T07:40:52.494 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2024-09-05T07:40:52.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-05T07:40:52.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-09-05T07:40:52.606 INFO:tasks.cephadm:Writing seed config... 2024-09-05T07:40:52.607 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-05T07:40:52.607 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-05T07:40:52.607 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-05T07:40:52.608 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-05T07:40:52.609 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-05T07:40:52.610 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-05T07:40:52.611 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-05T07:40:52.611 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-05T07:40:52.611 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-05T07:40:52.611 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-05T07:40:52.612 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:40:52.612 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-05T07:40:52.646 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 17138d32-6b5a-11ef-bcd6-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-05T07:40:52.647 DEBUG:teuthology.orchestra.run.smithi144:mon.a> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service 2024-09-05T07:40:52.691 DEBUG:teuthology.orchestra.run.smithi144:mgr.x> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x.service 2024-09-05T07:40:52.736 INFO:tasks.cephadm:Bootstrapping... 2024-09-05T07:40:52.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 -v bootstrap --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.144 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:40:52.992 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:40:52.992 INFO:teuthology.orchestra.run.smithi144.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', '-v', 'bootstrap', '--fsid', '17138d32-6b5a-11ef-bcd6-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.144', '--skip-admin-label'] 2024-09-05T07:40:52.993 INFO:teuthology.orchestra.run.smithi144.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-05T07:40:52.993 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying podman|docker is present... 2024-09-05T07:40:53.039 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stdout 5.2.2 2024-09-05T07:40:53.039 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying lvm2 is present... 2024-09-05T07:40:53.039 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying time synchronization is in place... 2024-09-05T07:40:53.052 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T07:40:53.052 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T07:40:53.065 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T07:40:53.065 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:40:53.078 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout enabled 2024-09-05T07:40:53.091 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout active 2024-09-05T07:40:53.091 INFO:teuthology.orchestra.run.smithi144.stdout:Unit chronyd.service is enabled and running 2024-09-05T07:40:53.091 INFO:teuthology.orchestra.run.smithi144.stdout:Repeating the final host check... 2024-09-05T07:40:53.135 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stdout 5.2.2 2024-09-05T07:40:53.135 INFO:teuthology.orchestra.run.smithi144.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-05T07:40:53.135 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl is present 2024-09-05T07:40:53.135 INFO:teuthology.orchestra.run.smithi144.stdout:lvcreate is present 2024-09-05T07:40:53.149 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T07:40:53.149 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T07:40:53.160 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T07:40:53.160 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:40:53.173 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout enabled 2024-09-05T07:40:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout active 2024-09-05T07:40:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:Unit chronyd.service is enabled and running 2024-09-05T07:40:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:Host looks OK 2024-09-05T07:40:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:Cluster fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:40:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:Acquiring lock 139998082802688 on /run/cephadm/17138d32-6b5a-11ef-bcd6-c7b262605968.lock 2024-09-05T07:40:53.187 INFO:teuthology.orchestra.run.smithi144.stdout:Lock 139998082802688 acquired on /run/cephadm/17138d32-6b5a-11ef-bcd6-c7b262605968.lock 2024-09-05T07:40:53.187 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying IP 172.21.15.144 port 3300 ... 2024-09-05T07:40:53.187 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying IP 172.21.15.144 port 6789 ... 2024-09-05T07:40:53.187 INFO:teuthology.orchestra.run.smithi144.stdout:Base mon IP(s) is [172.21.15.144:3300, 172.21.15.144:6789], mon addrv is [v2:172.21.15.144:3300,v1:172.21.15.144:6789] 2024-09-05T07:40:53.194 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.144 metric 100 2024-09-05T07:40:53.194 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.144 metric 100 2024-09-05T07:40:53.200 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-05T07:40:53.200 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-05T07:40:53.200 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-05T07:40:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T07:40:53.207 INFO:teuthology.orchestra.run.smithi144.stdout:Mon IP `172.21.15.144` is in CIDR network `172.21.0.0/20` 2024-09-05T07:40:53.207 INFO:teuthology.orchestra.run.smithi144.stdout:Mon IP `172.21.15.144` is in CIDR network `172.21.0.0/20` 2024-09-05T07:40:53.207 INFO:teuthology.orchestra.run.smithi144.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-05T07:40:53.208 INFO:teuthology.orchestra.run.smithi144.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-05T07:40:53.209 INFO:teuthology.orchestra.run.smithi144.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stdout 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Getting image source signatures 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Copying blob sha256:3f43494a24a2d1fe0d791eb19b05391e70ab9f54611bc9deae80cf7c3fb2dba9 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-05T07:40:53.824 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Copying config sha256:77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac 2024-09-05T07:40:53.825 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-05T07:40:54.928 INFO:teuthology.orchestra.run.smithi144.stdout:ceph: stdout ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable) 2024-09-05T07:40:54.928 INFO:teuthology.orchestra.run.smithi144.stdout:Ceph version: ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable) 2024-09-05T07:40:54.928 INFO:teuthology.orchestra.run.smithi144.stdout:Extracting ceph user uid/gid from container image... 2024-09-05T07:41:05.373 INFO:teuthology.orchestra.run.smithi144.stdout:stat: stdout 167 167 2024-09-05T07:41:05.373 INFO:teuthology.orchestra.run.smithi144.stdout:Creating initial keys... 2024-09-05T07:41:06.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph-authtool: stdout AQCRYNlmaS93LBAA1Gd3/mYgG6pJNa6/1Vv2fA== 2024-09-05T07:41:07.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph-authtool: stdout AQCSYNlmWTFTLRAAXTXxiV4YVDnBRfq+Hn8BaQ== 2024-09-05T07:41:08.539 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph-authtool: stdout AQCTYNlmL42QMhAAQ1BzzLUURj1yLFMUoSDjfw== 2024-09-05T07:41:08.540 INFO:teuthology.orchestra.run.smithi144.stdout:Creating initial monmap... 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool for a [v2:172.21.15.144:3300,v1:172.21.15.144:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = quincy 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: set fsid to 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T07:41:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:41:09.545 INFO:teuthology.orchestra.run.smithi144.stdout:Creating mon... 2024-09-05T07:41:11.566 INFO:teuthology.orchestra.run.smithi144.stdout:create mon.a on 2024-09-05T07:41:11.889 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-05T07:41:12.110 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-05T07:41:12.376 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target. 2024-09-05T07:41:12.376 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target. 2024-09-05T07:41:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a 2024-09-05T07:41:12.700 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Failed to reset failed state of unit ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service: Unit ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service not loaded. 2024-09-05T07:41:12.957 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target.wants/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service → /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@.service. 2024-09-05T07:41:13.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:13 smithi144 podman[29152]: 2024-09-05 07:41:13.530680099 +0000 UTC m=+0.342284407 container start e27ceb94f7967bdf3f08e487a60c3e7daabfd1dcf4b60758fa4593bb777af6ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-05T07:41:13.633 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T07:41:13.633 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout disabled 2024-09-05T07:41:13.647 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T07:41:13.647 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:41:13.647 INFO:teuthology.orchestra.run.smithi144.stdout:firewalld.service is not enabled 2024-09-05T07:41:13.647 INFO:teuthology.orchestra.run.smithi144.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T07:41:13.648 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mon to start... 2024-09-05T07:41:13.648 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mon... 2024-09-05T07:41:13.903 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:13 smithi144 ceph-mon[29171]: mkfs 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:13.903 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:13 smithi144 ceph-mon[29171]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T07:41:13.903 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:13 smithi144 bash[29152]: e27ceb94f7967bdf3f08e487a60c3e7daabfd1dcf4b60758fa4593bb777af6ef 2024-09-05T07:41:13.903 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:13 smithi144 systemd[1]: Started Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:41:14.780 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: monmap epoch 1 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: last_changed 2024-09-05T07:41:08.934859+0000 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: min_mon_release 19 (squid) 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: election_strategy: 1 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: fsmap 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: mgrmap e1: no daemons active 2024-09-05T07:41:14.794 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:14 smithi144 ceph-mon[29171]: from='client.? 172.21.15.144:0/3221192942' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout cluster: 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout id: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout services: 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.611945s) 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:14.801 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout data: 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout pgs: 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.123+0000 7fb4dc000640 1 Processor -- start 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.124+0000 7fb4dc000640 1 -- start start 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.124+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:14.802 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.124+0000 7fb4dc000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4107fc0 con 0x7fb4d4107680 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.125+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.125+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44528/0 (socket says 172.21.15.144:44528) 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.125+0000 7fb4d9600640 1 -- 172.21.15.144:0/2041138201 learned_addr learned my addr 172.21.15.144:0/2041138201 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.125+0000 7fb4d9600640 1 -- 172.21.15.144:0/2041138201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d4108140 con 0x7fb4d4107680 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.128+0000 7fb4d9600640 1 --2- 172.21.15.144:0/2041138201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009820 tx=0x7fb4c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe13b43e06f1aaad server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.128+0000 7fb4d3e00640 1 -- 172.21.15.144:0/2041138201 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c8037070 con 0x7fb4d4107680 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.128+0000 7fb4d3e00640 1 -- 172.21.15.144:0/2041138201 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4d4107680 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.128+0000 7fb4d3e00640 1 -- 172.21.15.144:0/2041138201 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c8032740 con 0x7fb4d4107680 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 -- 172.21.15.144:0/2041138201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 msgr2=0x7fb4d4107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 --2- 172.21.15.144:0/2041138201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009820 tx=0x7fb4c802a270 comp rx=0 tx=0).stop 2024-09-05T07:41:14.803 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 -- 172.21.15.144:0/2041138201 shutdown_connections 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 --2- 172.21.15.144:0/2041138201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d4107a80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 -- 172.21.15.144:0/2041138201 >> 172.21.15.144:0/2041138201 conn(0x7fb4d4102eb0 msgr2=0x7fb4d41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 -- 172.21.15.144:0/2041138201 shutdown_connections 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.129+0000 7fb4dc000640 1 -- 172.21.15.144:0/2041138201 wait complete. 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.130+0000 7fb4dc000640 1 Processor -- start 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.130+0000 7fb4dc000640 1 -- start start 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.130+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.130+0000 7fb4dc000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4108ba0 con 0x7fb4d4107680 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.130+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44538/0 (socket says 172.21.15.144:44538) 2024-09-05T07:41:14.804 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d9600640 1 -- 172.21.15.144:0/3221192942 learned_addr learned my addr 172.21.15.144:0/3221192942 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d9600640 1 -- 172.21.15.144:0/3221192942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d419b350 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d9600640 1 --2- 172.21.15.144:0/3221192942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80090b0 tx=0x7fb4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c8041070 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c803c7a0 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d419b5e0 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.131+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c8037040 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.132+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d419e2d0 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.132+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4c8044070 con 0x7fb4d4107680 2024-09-05T07:41:14.805 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.132+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4c803d3f0 con 0x7fb4d4107680 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.133+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d4107b00 con 0x7fb4d4107680 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.136+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb4c8046450 con 0x7fb4d4107680 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.199+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb4d419e820 con 0x7fb4d4107680 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.199+0000 7fb4d2000640 1 -- 172.21.15.144:0/3221192942 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb4c8046630 con 0x7fb4d4107680 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 msgr2=0x7fb4d419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 --2- 172.21.15.144:0/3221192942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80090b0 tx=0x7fb4c80046c0 comp rx=0 tx=0).stop 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 shutdown_connections 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 --2- 172.21.15.144:0/3221192942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d4107680 0x7fb4d419ae10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 >> 172.21.15.144:0/3221192942 conn(0x7fb4d4102eb0 msgr2=0x7fb4d418f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 shutdown_connections 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:14.200+0000 7fb4dc000640 1 -- 172.21.15.144:0/3221192942 wait complete. 2024-09-05T07:41:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:mon is available 2024-09-05T07:41:14.807 INFO:teuthology.orchestra.run.smithi144.stdout:Assimilating anything we can from ceph.conf... 2024-09-05T07:41:15.961 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:15 smithi144 ceph-mon[29171]: from='client.? 172.21.15.144:0/3824457930' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T07:41:15.961 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:15 smithi144 ceph-mon[29171]: from='client.? 172.21.15.144:0/3824457930' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-05T07:41:15.975 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:15.975 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T07:41:15.975 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout fsid = 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.144:3300,v1:172.21.15.144:6789] 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T07:41:15.976 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.255+0000 7f7242a00640 1 Processor -- start 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.255+0000 7f7242a00640 1 -- start start 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f7242a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f7242a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f723c10a290 con 0x7f723c1098c0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f723be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f723be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44548/0 (socket says 172.21.15.144:44548) 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f723be00640 1 -- 172.21.15.144:0/1414991688 learned_addr learned my addr 172.21.15.144:0/1414991688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.256+0000 7f723be00640 1 -- 172.21.15.144:0/1414991688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c10aa70 con 0x7f723c1098c0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.257+0000 7f723be00640 1 --2- 172.21.15.144:0/1414991688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f722c009820 tx=0x7f722c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309a3f0c7ada5444 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f723b400640 1 -- 172.21.15.144:0/1414991688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722c037070 con 0x7f723c1098c0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f723b400640 1 -- 172.21.15.144:0/1414991688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c032440 con 0x7f723c1098c0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f723b400640 1 -- 172.21.15.144:0/1414991688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722c032740 con 0x7f723c1098c0 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 -- 172.21.15.144:0/1414991688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 msgr2=0x7f723c109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 --2- 172.21.15.144:0/1414991688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f722c009820 tx=0x7f722c02a270 comp rx=0 tx=0).stop 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 -- 172.21.15.144:0/1414991688 shutdown_connections 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 --2- 172.21.15.144:0/1414991688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c109cc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:15.978 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 -- 172.21.15.144:0/1414991688 >> 172.21.15.144:0/1414991688 conn(0x7f723c07cf40 msgr2=0x7f723c07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 -- 172.21.15.144:0/1414991688 shutdown_connections 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.258+0000 7f7242a00640 1 -- 172.21.15.144:0/1414991688 wait complete. 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.259+0000 7f7242a00640 1 Processor -- start 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.259+0000 7f7242a00640 1 -- start start 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f7242a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f7242a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f723c10afa0 con 0x7f723c1098c0 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f723be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f723be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44564/0 (socket says 172.21.15.144:44564) 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f723be00640 1 -- 172.21.15.144:0/3824457930 learned_addr learned my addr 172.21.15.144:0/3824457930 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:15.979 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.260+0000 7f723be00640 1 -- 172.21.15.144:0/3824457930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c19d590 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f723be00640 1 --2- 172.21.15.144:0/3824457930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f722c0090b0 tx=0x7f722c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722c041070 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c03c7a0 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722c037040 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c19d820 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c1a0510 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f722c044070 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.261+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f722c03d730 con 0x7f723c1098c0 2024-09-05T07:41:15.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.262+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c10b5f0 con 0x7f723c1098c0 2024-09-05T07:41:15.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.265+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f722c03cbe0 con 0x7f723c1098c0 2024-09-05T07:41:15.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.325+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f723c19dd00 con 0x7f723c1098c0 2024-09-05T07:41:15.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.328+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f723c19dd00 con 0x7f723c1098c0 2024-09-05T07:41:15.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.329+0000 7f7239600640 1 -- 172.21.15.144:0/3824457930 <== mon.0 v2:172.21.15.144:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f722c032440 con 0x7f723c1098c0 2024-09-05T07:41:15.981 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 msgr2=0x7f723c19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 --2- 172.21.15.144:0/3824457930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f722c0090b0 tx=0x7f722c0046c0 comp rx=0 tx=0).stop 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 shutdown_connections 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 --2- 172.21.15.144:0/3824457930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f723c1098c0 0x7f723c19d050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 >> 172.21.15.144:0/3824457930 conn(0x7f723c07cf40 msgr2=0x7f723c1912a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 shutdown_connections 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:15.330+0000 7f7242a00640 1 -- 172.21.15.144:0/3824457930 wait complete. 2024-09-05T07:41:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:Generating new minimal ceph.conf... 2024-09-05T07:41:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:16 smithi144 ceph-mon[29171]: from='client.? 172.21.15.144:0/4233518704' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:41:17.206 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.519+0000 7fce11000640 1 Processor -- start 2024-09-05T07:41:17.206 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.519+0000 7fce11000640 1 -- start start 2024-09-05T07:41:17.206 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.519+0000 7fce11000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.519+0000 7fce11000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c10a310 con 0x7fce0c109920 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.520+0000 7fce09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.520+0000 7fce09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44578/0 (socket says 172.21.15.144:44578) 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.520+0000 7fce09e00640 1 -- 172.21.15.144:0/1229639305 learned_addr learned my addr 172.21.15.144:0/1229639305 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.520+0000 7fce09e00640 1 -- 172.21.15.144:0/1229639305 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c10aa10 con 0x7fce0c109920 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.521+0000 7fce09e00640 1 --2- 172.21.15.144:0/1229639305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009820 tx=0x7fcdfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57680d4102dd780b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce08a00640 1 -- 172.21.15.144:0/1229639305 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc037070 con 0x7fce0c109920 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce08a00640 1 -- 172.21.15.144:0/1229639305 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcdfc032900 con 0x7fce0c109920 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce08a00640 1 -- 172.21.15.144:0/1229639305 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc030850 con 0x7fce0c109920 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce11000640 1 -- 172.21.15.144:0/1229639305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 msgr2=0x7fce0c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:17.207 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce11000640 1 --2- 172.21.15.144:0/1229639305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009820 tx=0x7fcdfc02a270 comp rx=0 tx=0).stop 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce11000640 1 -- 172.21.15.144:0/1229639305 shutdown_connections 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce11000640 1 --2- 172.21.15.144:0/1229639305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c109d40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.522+0000 7fce11000640 1 -- 172.21.15.144:0/1229639305 >> 172.21.15.144:0/1229639305 conn(0x7fce0c07cf40 msgr2=0x7fce0c07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.523+0000 7fce11000640 1 -- 172.21.15.144:0/1229639305 shutdown_connections 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.523+0000 7fce11000640 1 -- 172.21.15.144:0/1229639305 wait complete. 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.523+0000 7fce11000640 1 Processor -- start 2024-09-05T07:41:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce11000640 1 -- start start 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce11000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce11000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c10ddc0 con 0x7fce0c109920 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44594/0 (socket says 172.21.15.144:44594) 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce09e00640 1 -- 172.21.15.144:0/4233518704 learned_addr learned my addr 172.21.15.144:0/4233518704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.524+0000 7fce09e00640 1 -- 172.21.15.144:0/4233518704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c19dd70 con 0x7fce0c109920 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce09e00640 1 --2- 172.21.15.144:0/4233518704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097f0 tx=0x7fcdfc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:17.209 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc037040 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcdfc040070 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc03a390 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c19e000 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c1a0cf0 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.525+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcdfc03a5e0 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.526+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcdfc045950 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.526+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c10df40 con 0x7fce0c109920 2024-09-05T07:41:17.210 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.529+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcdfc045460 con 0x7fce0c109920 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.592+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fce0c1a0ec0 con 0x7fce0c109920 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.592+0000 7fce02a00640 1 -- 172.21.15.144:0/4233518704 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fcdfc03b430 con 0x7fce0c109920 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 msgr2=0x7fce0c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 --2- 172.21.15.144:0/4233518704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097f0 tx=0x7fcdfc030d80 comp rx=0 tx=0).stop 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 shutdown_connections 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 --2- 172.21.15.144:0/4233518704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0c109920 0x7fce0c19d830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:17.211 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 >> 172.21.15.144:0/4233518704 conn(0x7fce0c07cf40 msgr2=0x7fce0c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:17.212 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 shutdown_connections 2024-09-05T07:41:17.212 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:16.593+0000 7fce11000640 1 -- 172.21.15.144:0/4233518704 wait complete. 2024-09-05T07:41:17.212 INFO:teuthology.orchestra.run.smithi144.stdout:Restarting the monitor... 2024-09-05T07:41:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:17 smithi144 systemd[1]: Stopping Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:41:17.997 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a[29167]: 2024-09-05T07:41:17.598+0000 7fa457e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:41:17.997 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a[29167]: 2024-09-05T07:41:17.598+0000 7fa457e00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-05T07:41:17.998 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:17 smithi144 podman[29412]: 2024-09-05 07:41:17.722906443 +0000 UTC m=+0.300897067 container died e27ceb94f7967bdf3f08e487a60c3e7daabfd1dcf4b60758fa4593bb777af6ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-05T07:41:18.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 podman[29412]: 2024-09-05 07:41:18.111855129 +0000 UTC m=+0.689845742 container cleanup e27ceb94f7967bdf3f08e487a60c3e7daabfd1dcf4b60758fa4593bb777af6ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:41:18.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 bash[29412]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a 2024-09-05T07:41:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 podman[29423]: 2024-09-05 07:41:18.371471355 +0000 UTC m=+0.635963560 container remove e27ceb94f7967bdf3f08e487a60c3e7daabfd1dcf4b60758fa4593bb777af6ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-05T07:41:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-05T07:41:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 systemd[1]: Stopped Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:41:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service: Consumed 1.196s CPU time. 2024-09-05T07:41:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 systemd[1]: Starting Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:41:19.106 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 podman[29516]: 2024-09-05 07:41:18.754602031 +0000 UTC m=+0.026808614 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:41:19.107 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:18 smithi144 podman[29516]: 2024-09-05 07:41:18.855864168 +0000 UTC m=+0.128070736 container create 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T07:41:19.107 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 podman[29516]: 2024-09-05 07:41:19.066456215 +0000 UTC m=+0.338662795 container init 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-05T07:41:19.107 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 podman[29516]: 2024-09-05 07:41:19.073386984 +0000 UTC m=+0.345593546 container start 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-05T07:41:19.158 INFO:teuthology.orchestra.run.smithi144.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-05T07:41:19.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: set uid:gid to 167:167 (ceph:ceph) 2024-09-05T07:41:19.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable), process ceph-mon, pid 2 2024-09-05T07:41:19.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: pidfile_write: ignore empty --pid-file 2024-09-05T07:41:19.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: load: jerasure load: lrc 2024-09-05T07:41:19.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: RocksDB version: 7.9.2 2024-09-05T07:41:19.464 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Git sha 0 2024-09-05T07:41:19.464 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Compile date 2024-09-04 15:32:03 2024-09-05T07:41:19.464 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: DB SUMMARY 2024-09-05T07:41:19.464 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: DB Session ID: 3B7QFVLM0KXPE8YUX7VB 2024-09-05T07:41:19.464 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: CURRENT file: CURRENT 2024-09-05T07:41:19.465 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: IDENTITY file: IDENTITY 2024-09-05T07:41:19.465 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-05T07:41:19.465 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-05T07:41:19.465 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105450 ; 2024-09-05T07:41:19.465 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.error_if_exists: 0 2024-09-05T07:41:19.466 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.create_if_missing: 0 2024-09-05T07:41:19.466 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.paranoid_checks: 1 2024-09-05T07:41:19.466 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.env: 0x562c51630940 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.fs: PosixFileSystem 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.info_log: 0x562c89f896a0 2024-09-05T07:41:19.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_file_opening_threads: 16 2024-09-05T07:41:19.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.statistics: (nil) 2024-09-05T07:41:19.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.use_fsync: 0 2024-09-05T07:41:19.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_log_file_size: 0 2024-09-05T07:41:19.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-05T07:41:19.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.keep_log_file_num: 1000 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.recycle_log_file_num: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_fallocate: 1 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_mmap_reads: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_mmap_writes: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.use_direct_reads: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.create_missing_column_families: 0 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.db_log_dir: 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.wal_dir: 2024-09-05T07:41:19.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.advise_random_on_open: 1 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.db_write_buffer_size: 0 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.write_buffer_manager: 0x562c89f98dc0 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.rate_limiter: (nil) 2024-09-05T07:41:19.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.wal_recovery_mode: 2 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enable_thread_tracking: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enable_pipelined_write: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.unordered_write: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.row_cache: None 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.wal_filter: None 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_ingest_behind: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.two_write_queues: 0 2024-09-05T07:41:19.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.manual_wal_flush: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.wal_compression: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.atomic_flush: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.log_readahead_size: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.best_efforts_recovery: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.allow_data_in_errors: 0 2024-09-05T07:41:19.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.db_host_id: __hostname__ 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_background_jobs: 2 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_background_compactions: -1 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_subcompactions: 1 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_total_wal_size: 0 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-05T07:41:19.473 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_open_files: -1 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bytes_per_sync: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_readahead_size: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_background_flushes: -1 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Compression algorithms supported: 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kZSTD supported: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kXpressCompression supported: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kBZip2Compression supported: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kLZ4Compression supported: 1 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kZlibCompression supported: 1 2024-09-05T07:41:19.474 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kLZ4HCCompression supported: 1 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: kSnappyCompression supported: 1 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.merge_operator: 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_filter: None 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_filter_factory: None 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.sst_partitioner_factory: None 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562c89f89300) 2024-09-05T07:41:19.475 INFO:journalctl@ceph.mon.a.smithi144.stdout: cache_index_and_filter_blocks: 1 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: pin_top_level_index_and_filter: 1 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: index_type: 0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: data_block_index_type: 0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: index_shortening: 1 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: checksum: 4 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: no_block_cache: 0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_cache: 0x562c89f7d1f0 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_cache_name: BinnedLRUCache 2024-09-05T07:41:19.476 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_cache_options: 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: capacity : 536870912 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: num_shard_bits : 4 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: strict_capacity_limit : 0 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: high_pri_pool_ratio: 0.000 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_cache_compressed: (nil) 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: persistent_cache: (nil) 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_size: 4096 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_size_deviation: 10 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_restart_interval: 16 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: index_block_restart_interval: 1 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: metadata_block_size: 4096 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: partition_filters: 0 2024-09-05T07:41:19.477 INFO:journalctl@ceph.mon.a.smithi144.stdout: use_delta_encoding: 1 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: filter_policy: bloomfilter 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: whole_key_filtering: 1 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: verify_compression: 0 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: read_amp_bytes_per_bit: 0 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: format_version: 5 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: enable_index_compression: 1 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: block_align: 0 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: max_auto_readahead_size: 262144 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: prepopulate_block_cache: 0 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: initial_auto_readahead_size: 8192 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout: num_file_reads_for_auto_readahead: 2 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.write_buffer_size: 33554432 2024-09-05T07:41:19.478 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_write_buffer_number: 2 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression: NoCompression 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression: Disabled 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.prefix_extractor: nullptr 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.num_levels: 7 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-05T07:41:19.479 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.level: 32767 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.strategy: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.enabled: false 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-05T07:41:19.480 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.target_file_size_base: 67108864 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-05T07:41:19.481 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.arena_block_size: 1048576 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.disable_auto_compactions: 0 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-05T07:41:19.482 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.inplace_update_support: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.bloom_locality: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.max_successive_merges: 0 2024-09-05T07:41:19.483 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.paranoid_file_checks: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.force_consistency_checks: 1 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.report_bg_io_stats: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.ttl: 2592000 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enable_blob_files: false 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.min_blob_size: 0 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_file_size: 268435456 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-05T07:41:19.484 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.blob_file_starting_level: 0 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: da4cd0d8-a20f-4d80-91b3-92ebc22f6182 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725522079115185, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725522079116833, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100498, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98392, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14320, "raw_average_key_size": 49, "raw_value_size": 90645, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725522079, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "da4cd0d8-a20f-4d80-91b3-92ebc22f6182", "db_session_id": "3B7QFVLM0KXPE8YUX7VB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725522079117074, "job": 1, "event": "recovery_finished"} 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-05T07:41:19.485 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562c89face00 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: DB pointer 0x562c8a0a8000 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: ** DB Stats ** 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T07:41:19.486 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: ** Compaction Stats [default] ** 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: L0 2/0 100.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: Sum 2/0 100.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: ** Compaction Stats [default] ** 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 91.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.487 INFO:journalctl@ceph.mon.a.smithi144.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Cumulative compaction: 0.00 GB write, 15.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Interval compaction: 0.00 GB write, 15.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Block cache BinnedLRUCache@0x562c89f7d1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.488 INFO:journalctl@ceph.mon.a.smithi144.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: starting mon.a rank 0 at public addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] at bind addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???) e1 preinit fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).mds e1 new map 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).mds e1 print_map 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: e1 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: btime 2024-09-05T07:41:13:589495+0000 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: legacy client fscid: -1 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout: No filesystems configured 2024-09-05T07:41:19.489 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 bash[29516]: 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 systemd[1]: Started Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: monmap epoch 1 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: last_changed 2024-09-05T07:41:08.934859+0000 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: min_mon_release 19 (squid) 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: election_strategy: 1 2024-09-05T07:41:19.490 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:41:19.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: fsmap 2024-09-05T07:41:19.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T07:41:19.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:19 smithi144 ceph-mon[29535]: mgrmap e1: no daemons active 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.685+0000 7f1cacc00640 1 Processor -- start 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1cacc00640 1 -- start start 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1cacc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1cacc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca810a240 con 0x7f1ca8109870 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:20.332 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44608/0 (socket says 172.21.15.144:44608) 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.686+0000 7f1ca5e00640 1 -- 172.21.15.144:0/989516859 learned_addr learned my addr 172.21.15.144:0/989516859 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.687+0000 7f1ca5e00640 1 -- 172.21.15.144:0/989516859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca810aa10 con 0x7f1ca8109870 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.689+0000 7f1ca5e00640 1 --2- 172.21.15.144:0/989516859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009820 tx=0x7f1c9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a35297a27a1b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1ca4a00640 1 -- 172.21.15.144:0/989516859 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c98037070 con 0x7f1ca8109870 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1ca4a00640 1 -- 172.21.15.144:0/989516859 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c98032900 con 0x7f1ca8109870 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1ca4a00640 1 -- 172.21.15.144:0/989516859 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c98030850 con 0x7f1ca8109870 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1cacc00640 1 -- 172.21.15.144:0/989516859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 msgr2=0x7f1ca8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1cacc00640 1 --2- 172.21.15.144:0/989516859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009820 tx=0x7f1c9802a270 comp rx=0 tx=0).stop 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1cacc00640 1 -- 172.21.15.144:0/989516859 shutdown_connections 2024-09-05T07:41:20.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1cacc00640 1 --2- 172.21.15.144:0/989516859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca8109c70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.690+0000 7f1cacc00640 1 -- 172.21.15.144:0/989516859 >> 172.21.15.144:0/989516859 conn(0x7f1ca807cf40 msgr2=0x7f1ca807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.691+0000 7f1cacc00640 1 -- 172.21.15.144:0/989516859 shutdown_connections 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.691+0000 7f1cacc00640 1 -- 172.21.15.144:0/989516859 wait complete. 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.691+0000 7f1cacc00640 1 Processor -- start 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1cacc00640 1 -- start start 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1cacc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1cacc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca810ddc0 con 0x7f1ca8109870 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1ca5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44612/0 (socket says 172.21.15.144:44612) 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1ca5e00640 1 -- 172.21.15.144:0/1086753523 learned_addr learned my addr 172.21.15.144:0/1086753523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:20.334 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.692+0000 7f1ca5e00640 1 -- 172.21.15.144:0/1086753523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca819dd20 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1ca5e00640 1 --2- 172.21.15.144:0/1086753523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c98032ce0 tx=0x7f1c98032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c98042070 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c980308c0 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca819dfb0 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c98037040 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca81a0ca0 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.693+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c98045070 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.694+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1c98047b70 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.694+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca8109c70 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.697+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1c9803dbf0 con 0x7f1ca8109870 2024-09-05T07:41:20.335 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.756+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f1ca81a1280 con 0x7f1ca8109870 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.758+0000 7f1c9ea00640 1 -- 172.21.15.144:0/1086753523 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f1c9803d430 con 0x7f1ca8109870 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.759+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 msgr2=0x7f1ca819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.759+0000 7f1cacc00640 1 --2- 172.21.15.144:0/1086753523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c98032ce0 tx=0x7f1c98032d10 comp rx=0 tx=0).stop 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.759+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 shutdown_connections 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.759+0000 7f1cacc00640 1 --2- 172.21.15.144:0/1086753523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ca8109870 0x7f1ca819d7e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.759+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 >> 172.21.15.144:0/1086753523 conn(0x7f1ca807cf40 msgr2=0x7f1ca8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.760+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 shutdown_connections 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:19.760+0000 7f1cacc00640 1 -- 172.21.15.144:0/1086753523 wait complete. 2024-09-05T07:41:20.336 INFO:teuthology.orchestra.run.smithi144.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-05T07:41:20.355 INFO:teuthology.orchestra.run.smithi144.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:41:20.355 INFO:teuthology.orchestra.run.smithi144.stdout:Creating mgr... 2024-09-05T07:41:20.355 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-05T07:41:20.356 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-05T07:41:20.697 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T07:41:20.697 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Failed to reset failed state of unit ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x.service: Unit ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x.service not loaded. 2024-09-05T07:41:20.929 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968.target.wants/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@.service. 2024-09-05T07:41:20.968 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:20 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1086753523' entity='client.admin' 2024-09-05T07:41:21.281 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:20 smithi144 systemd[1]: Starting Ceph mgr.x for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:41:21.560 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 podman[29746]: 2024-09-05 07:41:21.184245129 +0000 UTC m=+0.026701111 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:41:21.560 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 podman[29746]: 2024-09-05 07:41:21.282797734 +0000 UTC m=+0.125253716 container create bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-05T07:41:21.560 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 podman[29746]: 2024-09-05 07:41:21.476867739 +0000 UTC m=+0.319323742 container init bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:41:21.560 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 podman[29746]: 2024-09-05 07:41:21.482851072 +0000 UTC m=+0.325307055 container start bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-05T07:41:21.587 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T07:41:21.587 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout disabled 2024-09-05T07:41:21.601 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T07:41:21.602 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:41:21.602 INFO:teuthology.orchestra.run.smithi144.stdout:firewalld.service is not enabled 2024-09-05T07:41:21.602 INFO:teuthology.orchestra.run.smithi144.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T07:41:21.619 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T07:41:21.619 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout disabled 2024-09-05T07:41:21.633 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T07:41:21.633 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:41:21.633 INFO:teuthology.orchestra.run.smithi144.stdout:firewalld.service is not enabled 2024-09-05T07:41:21.633 INFO:teuthology.orchestra.run.smithi144.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-05T07:41:21.633 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mgr to start... 2024-09-05T07:41:21.634 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mgr... 2024-09-05T07:41:21.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 bash[29746]: bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 2024-09-05T07:41:21.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 systemd[1]: Started Ceph mgr.x for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:41:21.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:21.652+0000 7f4457618040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:41:21.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:21.725+0000 7f4457618040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:41:22.167 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:21.916+0000 7f4457618040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:41:22.167 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:21.999+0000 7f4457618040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:41:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2523030702' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T07:41:22.572 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:22.182+0000 7f4457618040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:41:22.572 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:22.362+0000 7f4457618040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:41:22.829 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:22.751+0000 7f4457618040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:41:22.829 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:22.827+0000 7f4457618040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:41:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:41:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 0 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-05T07:41:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T07:41:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T07:41:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T07:41:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T07:41:13:589495+0000", 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T07:41:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T07:41:13.590293+0000", 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.161+0000 7f0505800640 1 Processor -- start 2024-09-05T07:41:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.162+0000 7f0505800640 1 -- start start 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.162+0000 7f0505800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.162+0000 7f0505800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f050010a290 con 0x7f05001098c0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.162+0000 7f04fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.163+0000 7f04fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44644/0 (socket says 172.21.15.144:44644) 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.163+0000 7f04fea00640 1 -- 172.21.15.144:0/3522199371 learned_addr learned my addr 172.21.15.144:0/3522199371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.163+0000 7f04fea00640 1 -- 172.21.15.144:0/3522199371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050010aa70 con 0x7f05001098c0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.164+0000 7f04fea00640 1 --2- 172.21.15.144:0/3522199371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009820 tx=0x7f04f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d1203225f0f66f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.164+0000 7f04fd600640 1 -- 172.21.15.144:0/3522199371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f0037070 con 0x7f05001098c0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.164+0000 7f04fd600640 1 -- 172.21.15.144:0/3522199371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04f0032900 con 0x7f05001098c0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.164+0000 7f04fd600640 1 -- 172.21.15.144:0/3522199371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f0030850 con 0x7f05001098c0 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 -- 172.21.15.144:0/3522199371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 msgr2=0x7f0500109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 --2- 172.21.15.144:0/3522199371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009820 tx=0x7f04f002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 -- 172.21.15.144:0/3522199371 shutdown_connections 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 --2- 172.21.15.144:0/3522199371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f0500109cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 -- 172.21.15.144:0/3522199371 >> 172.21.15.144:0/3522199371 conn(0x7f050007cf40 msgr2=0x7f050007d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 -- 172.21.15.144:0/3522199371 shutdown_connections 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.165+0000 7f0505800640 1 -- 172.21.15.144:0/3522199371 wait complete. 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.166+0000 7f0505800640 1 Processor -- start 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.166+0000 7f0505800640 1 -- start start 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f0505800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f0505800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f050010de20 con 0x7f05001098c0 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f04fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f04fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44648/0 (socket says 172.21.15.144:44648) 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f04fea00640 1 -- 172.21.15.144:0/2523030702 learned_addr learned my addr 172.21.15.144:0/2523030702 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.167+0000 7f04fea00640 1 -- 172.21.15.144:0/2523030702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050019ddd0 con 0x7f05001098c0 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f04fea00640 1 --2- 172.21.15.144:0/2523030702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f04f00097f0 tx=0x7f04f0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f0037040 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04f0040070 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050019e060 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f003a390 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.168+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05001a0d50 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.169+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04f003a630 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.169+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04f0032a90 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.170+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0500109d40 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.174+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f04f0045460 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.239+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f05001a0f20 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.239+0000 7f04f7400640 1 -- 172.21.15.144:0/2523030702 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f04f0032c90 con 0x7f05001098c0 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 msgr2=0x7f050019d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 --2- 172.21.15.144:0/2523030702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f04f00097f0 tx=0x7f04f0030d80 comp rx=0 tx=0).stop 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 shutdown_connections 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 --2- 172.21.15.144:0/2523030702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05001098c0 0x7f050019d890 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 >> 172.21.15.144:0/2523030702 conn(0x7f050007cf40 msgr2=0x7f0500107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 shutdown_connections 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:22.241+0000 7f0505800640 1 -- 172.21.15.144:0/2523030702 wait complete. 2024-09-05T07:41:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:mgr not available, waiting (1/15)... 2024-09-05T07:41:23.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:23.049+0000 7f4457618040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:41:24.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:24.180+0000 7f4457618040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:41:24.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:24.259+0000 7f4457618040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:41:25.486 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.193+0000 7f4457618040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:41:25.486 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.339+0000 7f4457618040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:41:25.769 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/380278575' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T07:41:25.769 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.507+0000 7f4457618040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:41:25.770 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.585+0000 7f4457618040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:41:25.770 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.768+0000 7f4457618040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:41:26.040 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.863+0000 7f4457618040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:41:26.040 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:25.938+0000 7f4457618040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:41:26.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.125+0000 7f4457618040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:41:26.648 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.206+0000 7f4457618040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:41:26.648 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.285+0000 7f4457618040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:41:26.649 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.382+0000 7f4457618040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:41:26.649 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.452+0000 7f4457618040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:41:26.649 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:26.520+0000 7f4457618040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:41:26.658 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:26.658 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 0 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:26.659 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T07:41:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T07:41:26.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T07:41:26.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T07:41:26.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.669 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T07:41:13:589495+0000", 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:26.670 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T07:41:13.590293+0000", 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.510+0000 7f094d200640 1 Processor -- start 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.510+0000 7f094d200640 1 -- start start 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.510+0000 7f094d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:26.671 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.510+0000 7f094d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f094807c800 con 0x7f094807de60 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.511+0000 7f0947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.511+0000 7f0947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54200/0 (socket says 172.21.15.144:54200) 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.511+0000 7f0947400640 1 -- 172.21.15.144:0/2165658688 learned_addr learned my addr 172.21.15.144:0/2165658688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.511+0000 7f0947400640 1 -- 172.21.15.144:0/2165658688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094807c980 con 0x7f094807de60 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.512+0000 7f0947400640 1 --2- 172.21.15.144:0/2165658688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7527cdc4bbcf0a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f0946000640 1 -- 172.21.15.144:0/2165658688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938037070 con 0x7f094807de60 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f0946000640 1 -- 172.21.15.144:0/2165658688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0938032900 con 0x7f094807de60 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f0946000640 1 -- 172.21.15.144:0/2165658688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938030850 con 0x7f094807de60 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 -- 172.21.15.144:0/2165658688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 msgr2=0x7f094807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 --2- 172.21.15.144:0/2165658688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).stop 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 -- 172.21.15.144:0/2165658688 shutdown_connections 2024-09-05T07:41:26.672 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 --2- 172.21.15.144:0/2165658688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094807c2c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 -- 172.21.15.144:0/2165658688 >> 172.21.15.144:0/2165658688 conn(0x7f0948102c10 msgr2=0x7f0948105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 -- 172.21.15.144:0/2165658688 shutdown_connections 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.513+0000 7f094d200640 1 -- 172.21.15.144:0/2165658688 wait complete. 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.514+0000 7f094d200640 1 Processor -- start 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f094d200640 1 -- start start 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f094d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f094d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f094810da90 con 0x7f094807de60 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f0947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f0947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54208/0 (socket says 172.21.15.144:54208) 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.515+0000 7f0947400640 1 -- 172.21.15.144:0/380278575 learned_addr learned my addr 172.21.15.144:0/380278575 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:26.673 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f0947400640 1 -- 172.21.15.144:0/380278575 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094819dbe0 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f0947400640 1 --2- 172.21.15.144:0/380278575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0938031000 tx=0x7f09380326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938042070 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0938032be0 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938037040 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094819de70 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.516+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09481a0b60 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.517+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0938045070 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.517+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0938047b70 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.518+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094807c340 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.522+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f093804c030 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.586+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f09481a0d30 con 0x7f094807de60 2024-09-05T07:41:26.674 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.586+0000 7f093fe00640 1 -- 172.21.15.144:0/380278575 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f09380328a0 con 0x7f094807de60 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 msgr2=0x7f094819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 --2- 172.21.15.144:0/380278575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0938031000 tx=0x7f09380326e0 comp rx=0 tx=0).stop 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 shutdown_connections 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 --2- 172.21.15.144:0/380278575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094807de60 0x7f094819d6a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 >> 172.21.15.144:0/380278575 conn(0x7f0948102c10 msgr2=0x7f09481037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 shutdown_connections 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:25.588+0000 7f094d200640 1 -- 172.21.15.144:0/380278575 wait complete. 2024-09-05T07:41:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:mgr not available, waiting (2/15)... 2024-09-05T07:41:27.821 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:27.430+0000 7f4457618040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: Activating manager daemon x 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: mgrmap e2: x(active, starting, since 0.00443737s) 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: Manager daemon x is now available 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T07:41:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' 2024-09-05T07:41:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T07:41:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' 2024-09-05T07:41:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:27 smithi144 ceph-mon[29535]: from='mgr.14100 172.21.15.144:0/3582867442' entity='mgr.x' 2024-09-05T07:41:29.742 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:29 smithi144 ceph-mon[29535]: mgrmap e3: x(active, since 1.00957s) 2024-09-05T07:41:29.742 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:29 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3614023494' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T07:41:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 0 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:30.013 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T07:41:30.014 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T07:41:13:589495+0000", 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T07:41:30.015 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ], 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T07:41:30.016 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T07:41:13.590293+0000", 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout }, 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.160+0000 7f16e7e00640 1 Processor -- start 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.160+0000 7f16e7e00640 1 -- start start 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.160+0000 7f16e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.160+0000 7f16e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0108070 con 0x7f16e01076a0 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.161+0000 7f16e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.161+0000 7f16e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54272/0 (socket says 172.21.15.144:54272) 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.161+0000 7f16e5400640 1 -- 172.21.15.144:0/4165862855 learned_addr learned my addr 172.21.15.144:0/4165862855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:30.017 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.161+0000 7f16e5400640 1 -- 172.21.15.144:0/4165862855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e0108800 con 0x7f16e01076a0 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.162+0000 7f16e5400640 1 --2- 172.21.15.144:0/4165862855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009820 tx=0x7f16d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e21de01ea89699 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.162+0000 7f16dfe00640 1 -- 172.21.15.144:0/4165862855 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4037070 con 0x7f16e01076a0 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16dfe00640 1 -- 172.21.15.144:0/4165862855 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16d4032900 con 0x7f16e01076a0 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16dfe00640 1 -- 172.21.15.144:0/4165862855 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4030850 con 0x7f16e01076a0 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 -- 172.21.15.144:0/4165862855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 msgr2=0x7f16e0107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 --2- 172.21.15.144:0/4165862855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009820 tx=0x7f16d402a270 comp rx=0 tx=0).stop 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 -- 172.21.15.144:0/4165862855 shutdown_connections 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 --2- 172.21.15.144:0/4165862855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e0107aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 -- 172.21.15.144:0/4165862855 >> 172.21.15.144:0/4165862855 conn(0x7f16e0102e50 msgr2=0x7f16e0105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 -- 172.21.15.144:0/4165862855 shutdown_connections 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.163+0000 7f16e7e00640 1 -- 172.21.15.144:0/4165862855 wait complete. 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.164+0000 7f16e7e00640 1 Processor -- start 2024-09-05T07:41:30.018 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.164+0000 7f16e7e00640 1 -- start start 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16e010bbb0 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54280/0 (socket says 172.21.15.144:54280) 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e5400640 1 -- 172.21.15.144:0/3614023494 learned_addr learned my addr 172.21.15.144:0/3614023494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e5400640 1 -- 172.21.15.144:0/3614023494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e019dde0 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.165+0000 7f16e5400640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097f0 tx=0x7f16d4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.166+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4042070 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.166+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16d4032ca0 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.166+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4037040 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.166+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e019e070 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.166+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e01a0d60 con 0x7f16e01076a0 2024-09-05T07:41:30.019 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.167+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e010bd30 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.167+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f16d4045070 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.167+0000 7f16de000640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 0x7f16c803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.167+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16d406bc40 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.168+0000 7f16e4a00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 0x7f16c803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.168+0000 7f16e4a00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 0x7f16c803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0098c0 tx=0x7f16cc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.173+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16d404b170 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.412+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f16e01a13f0 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.412+0000 7f16de000640 1 -- 172.21.15.144:0/3614023494 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f16d403d430 con 0x7f16e01076a0 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.414+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 msgr2=0x7f16c803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.414+0000 7f16e7e00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 0x7f16c803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0098c0 tx=0x7f16cc006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.414+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 msgr2=0x7f16e019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:30.020 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.414+0000 7f16e7e00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097f0 tx=0x7f16d4030ec0 comp rx=0 tx=0).stop 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 shutdown_connections 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f16c8038e60 0x7f16c803b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 --2- 172.21.15.144:0/3614023494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01076a0 0x7f16e019d8a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 >> 172.21.15.144:0/3614023494 conn(0x7f16e0102e50 msgr2=0x7f16e01039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 shutdown_connections 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:29.415+0000 7f16e7e00640 1 -- 172.21.15.144:0/3614023494 wait complete. 2024-09-05T07:41:30.021 INFO:teuthology.orchestra.run.smithi144.stdout:mgr is available 2024-09-05T07:41:30.696 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:30 smithi144 ceph-mon[29535]: mgrmap e4: x(active, since 2s) 2024-09-05T07:41:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T07:41:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout fsid = 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.144:3300,v1:172.21.15.144:6789] 2024-09-05T07:41:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T07:41:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f0294c00640 1 Processor -- start 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f0294c00640 1 -- start start 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f0294c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f0294c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f029007c800 con 0x7f029007de60 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f028f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f028f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54282/0 (socket says 172.21.15.144:54282) 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.511+0000 7f028f400640 1 -- 172.21.15.144:0/18118194 learned_addr learned my addr 172.21.15.144:0/18118194 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.512+0000 7f028f400640 1 -- 172.21.15.144:0/18118194 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029007c980 con 0x7f029007de60 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f028f400640 1 --2- 172.21.15.144:0/18118194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0280009820 tx=0x7f028002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d659e6bdfa4ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f028ea00640 1 -- 172.21.15.144:0/18118194 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0280037070 con 0x7f029007de60 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f028ea00640 1 -- 172.21.15.144:0/18118194 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0280032900 con 0x7f029007de60 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f028ea00640 1 -- 172.21.15.144:0/18118194 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0280030850 con 0x7f029007de60 2024-09-05T07:41:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f0294c00640 1 -- 172.21.15.144:0/18118194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 msgr2=0x7f029007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.513+0000 7f0294c00640 1 --2- 172.21.15.144:0/18118194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0280009820 tx=0x7f028002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.514+0000 7f0294c00640 1 -- 172.21.15.144:0/18118194 shutdown_connections 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.514+0000 7f0294c00640 1 --2- 172.21.15.144:0/18118194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029007c2c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.514+0000 7f0294c00640 1 -- 172.21.15.144:0/18118194 >> 172.21.15.144:0/18118194 conn(0x7f0290102c10 msgr2=0x7f0290105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.514+0000 7f0294c00640 1 -- 172.21.15.144:0/18118194 shutdown_connections 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.514+0000 7f0294c00640 1 -- 172.21.15.144:0/18118194 wait complete. 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f0294c00640 1 Processor -- start 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f0294c00640 1 -- start start 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f0294c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f0294c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f029010da90 con 0x7f029007de60 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f028f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f028f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54286/0 (socket says 172.21.15.144:54286) 2024-09-05T07:41:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.515+0000 7f028f400640 1 -- 172.21.15.144:0/507853283 learned_addr learned my addr 172.21.15.144:0/507853283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f028f400640 1 -- 172.21.15.144:0/507853283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029019dbe0 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f028f400640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0280031000 tx=0x7f02800326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0280042070 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0280032be0 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029019de70 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0280037040 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.516+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a0b60 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.517+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f0280045070 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.517+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f029007c340 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.518+0000 7f028cc00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 0x7f027403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.518+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f028006bf00 con 0x7f029007de60 2024-09-05T07:41:31.325 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.518+0000 7f0287e00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 0x7f027403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.518+0000 7f0287e00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 0x7f027403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02780098c0 tx=0x7f0278006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.523+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f028002f2a0 con 0x7f029007de60 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.696+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f02901a0d30 con 0x7f029007de60 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.697+0000 7f028cc00640 1 -- 172.21.15.144:0/507853283 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f0280032d90 con 0x7f029007de60 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.699+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 msgr2=0x7f027403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.699+0000 7f0294c00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 0x7f027403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02780098c0 tx=0x7f0278006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.699+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 msgr2=0x7f029019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.699+0000 7f0294c00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0280031000 tx=0x7f02800326e0 comp rx=0 tx=0).stop 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 shutdown_connections 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f0274038f70 0x7f027403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 --2- 172.21.15.144:0/507853283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029007de60 0x7f029019d6a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 >> 172.21.15.144:0/507853283 conn(0x7f0290102c10 msgr2=0x7f02901037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 shutdown_connections 2024-09-05T07:41:31.326 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:30.700+0000 7f0294c00640 1 -- 172.21.15.144:0/507853283 wait complete. 2024-09-05T07:41:31.327 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling cephadm module... 2024-09-05T07:41:31.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:31 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/507853283' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T07:41:32.737 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2430588285' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-05T07:41:32.737 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ignoring --setuser ceph since I am not root 2024-09-05T07:41:32.737 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ignoring --setgroup ceph since I am not root 2024-09-05T07:41:32.737 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:32.667+0000 7ffbc5a36040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:41:32.738 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:32.736+0000 7ffbc5a36040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:41:33.003 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:32.921+0000 7ffbc5a36040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:41:33.004 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:33.002+0000 7ffbc5a36040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:41:33.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.792+0000 7fb7d1400640 1 Processor -- start 2024-09-05T07:41:33.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.792+0000 7fb7d1400640 1 -- start start 2024-09-05T07:41:33.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.792+0000 7fb7d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:33.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.792+0000 7fb7d1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc10a290 con 0x7fb7cc1098c0 2024-09-05T07:41:33.043 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.793+0000 7fb7ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.793+0000 7fb7ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54300/0 (socket says 172.21.15.144:54300) 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.793+0000 7fb7ca800640 1 -- 172.21.15.144:0/3778835258 learned_addr learned my addr 172.21.15.144:0/3778835258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.793+0000 7fb7ca800640 1 -- 172.21.15.144:0/3778835258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc10aa70 con 0x7fb7cc1098c0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.794+0000 7fb7ca800640 1 --2- 172.21.15.144:0/3778835258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009820 tx=0x7fb7bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d348f119692e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.794+0000 7fb7c9400640 1 -- 172.21.15.144:0/3778835258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc037070 con 0x7fb7cc1098c0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.794+0000 7fb7c9400640 1 -- 172.21.15.144:0/3778835258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7bc032900 con 0x7fb7cc1098c0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.794+0000 7fb7c9400640 1 -- 172.21.15.144:0/3778835258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc030850 con 0x7fb7cc1098c0 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 -- 172.21.15.144:0/3778835258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 msgr2=0x7fb7cc109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 --2- 172.21.15.144:0/3778835258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009820 tx=0x7fb7bc02a270 comp rx=0 tx=0).stop 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 -- 172.21.15.144:0/3778835258 shutdown_connections 2024-09-05T07:41:33.044 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 --2- 172.21.15.144:0/3778835258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc109cc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 -- 172.21.15.144:0/3778835258 >> 172.21.15.144:0/3778835258 conn(0x7fb7cc07cf40 msgr2=0x7fb7cc07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 -- 172.21.15.144:0/3778835258 shutdown_connections 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.795+0000 7fb7d1400640 1 -- 172.21.15.144:0/3778835258 wait complete. 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.796+0000 7fb7d1400640 1 Processor -- start 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.796+0000 7fb7d1400640 1 -- start start 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.796+0000 7fb7d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.796+0000 7fb7d1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc10de20 con 0x7fb7cc1098c0 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.797+0000 7fb7ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:33.045 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.797+0000 7fb7ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54310/0 (socket says 172.21.15.144:54310) 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.797+0000 7fb7ca800640 1 -- 172.21.15.144:0/2430588285 learned_addr learned my addr 172.21.15.144:0/2430588285 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.797+0000 7fb7ca800640 1 -- 172.21.15.144:0/2430588285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc19ddd0 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.797+0000 7fb7ca800640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0097f0 tx=0x7fb7bc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.798+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc037040 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.798+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7bc040070 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.798+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc19e060 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.798+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc03a390 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.798+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc1a0d50 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.799+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fb7bc03a630 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.799+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc109d40 con 0x7fb7cc1098c0 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.799+0000 7fb7c3400640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 0x7fb7b003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:33.046 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.799+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb7bc06c350 con 0x7fb7cc1098c0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.799+0000 7fb7c9e00640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 0x7fb7b003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.800+0000 7fb7c9e00640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 0x7fb7b003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80098c0 tx=0x7fb7b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:31.804+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7bc06c0b0 con 0x7fb7cc1098c0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.023+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fb7cc1a0f20 con 0x7fb7cc1098c0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.447+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fb7bc043760 con 0x7fb7cc1098c0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.448+0000 7fb7c3400640 1 -- 172.21.15.144:0/2430588285 <== mon.0 v2:172.21.15.144:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb7bc045460 con 0x7fb7cc1098c0 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 msgr2=0x7fb7b003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 0x7fb7b003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80098c0 tx=0x7fb7b8006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 msgr2=0x7fb7cc19d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0097f0 tx=0x7fb7bc030d80 comp rx=0 tx=0).stop 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 shutdown_connections 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7fb7b0038f20 0x7fb7b003b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:33.047 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 --2- 172.21.15.144:0/2430588285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc1098c0 0x7fb7cc19d890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:33.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.450+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 >> 172.21.15.144:0/2430588285 conn(0x7fb7cc07cf40 msgr2=0x7fb7cc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:33.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.451+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 shutdown_connections 2024-09-05T07:41:33.048 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:32.451+0000 7fb7d1400640 1 -- 172.21.15.144:0/2430588285 wait complete. 2024-09-05T07:41:33.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:33.188+0000 7ffbc5a36040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:41:33.584 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2430588285' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-05T07:41:33.584 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-mon[29535]: mgrmap e5: x(active, since 5s) 2024-09-05T07:41:33.584 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:33.358+0000 7ffbc5a36040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:41:33.840 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:33.734+0000 7ffbc5a36040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:41:33.840 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:33.807+0000 7ffbc5a36040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:41:34.154 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:34.024+0000 7ffbc5a36040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:41:34.456 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:41:34.456 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-05T07:41:34.456 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T07:41:34.456 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.583+0000 7f1d9f200640 1 Processor -- start 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.583+0000 7f1d9f200640 1 -- start start 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.583+0000 7f1d9f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.583+0000 7f1d9f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1da007c8b0 con 0x7f1da007de80 2024-09-05T07:41:34.457 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.584+0000 7f1d9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.584+0000 7f1d9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42954/0 (socket says 172.21.15.144:42954) 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.584+0000 7f1d9de00640 1 -- 172.21.15.144:0/1404937664 learned_addr learned my addr 172.21.15.144:0/1404937664 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.584+0000 7f1d9de00640 1 -- 172.21.15.144:0/1404937664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da007ca30 con 0x7f1da007de80 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.586+0000 7f1d9de00640 1 --2- 172.21.15.144:0/1404937664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009820 tx=0x7f1d9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8fc920757c75e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.586+0000 7f1d9ca00640 1 -- 172.21.15.144:0/1404937664 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90037070 con 0x7f1da007de80 2024-09-05T07:41:34.458 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.586+0000 7f1d9ca00640 1 -- 172.21.15.144:0/1404937664 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d90032900 con 0x7f1da007de80 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.586+0000 7f1d9ca00640 1 -- 172.21.15.144:0/1404937664 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90030850 con 0x7f1da007de80 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 -- 172.21.15.144:0/1404937664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 msgr2=0x7f1da007c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 --2- 172.21.15.144:0/1404937664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009820 tx=0x7f1d9002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 -- 172.21.15.144:0/1404937664 shutdown_connections 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 --2- 172.21.15.144:0/1404937664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da007c2e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:34.459 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 -- 172.21.15.144:0/1404937664 >> 172.21.15.144:0/1404937664 conn(0x7f1da0102c10 msgr2=0x7f1da0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:34.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 -- 172.21.15.144:0/1404937664 shutdown_connections 2024-09-05T07:41:34.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.587+0000 7f1d9f200640 1 -- 172.21.15.144:0/1404937664 wait complete. 2024-09-05T07:41:34.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9f200640 1 Processor -- start 2024-09-05T07:41:34.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9f200640 1 -- start start 2024-09-05T07:41:34.460 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010da70 con 0x7f1da007de80 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42966/0 (socket says 172.21.15.144:42966) 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.588+0000 7f1d9de00640 1 -- 172.21.15.144:0/4206917878 learned_addr learned my addr 172.21.15.144:0/4206917878 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d9de00640 1 -- 172.21.15.144:0/4206917878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da010ac30 con 0x7f1da007de80 2024-09-05T07:41:34.461 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d9de00640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d90030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90042070 con 0x7f1da007de80 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d90032ca0 con 0x7f1da007de80 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d90037040 con 0x7f1da007de80 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.589+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da010aec0 con 0x7f1da007de80 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.590+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da0107480 con 0x7f1da007de80 2024-09-05T07:41:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.591+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da010b090 con 0x7f1da007de80 2024-09-05T07:41:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.591+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f1d90045070 con 0x7f1da007de80 2024-09-05T07:41:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.591+0000 7f1d96a00640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 0x7f1d8403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.591+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1d9006bf70 con 0x7f1da007de80 2024-09-05T07:41:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.591+0000 7f1d9d400640 1 -- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 msgr2=0x7f1d8403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.592+0000 7f1d9d400640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 0x7f1d8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:41:34.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.597+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1da010b090 con 0x7f1da007de80 2024-09-05T07:41:34.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.793+0000 7f1d9d400640 1 -- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 msgr2=0x7f1d8403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:34.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.793+0000 7f1d9d400640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 0x7f1d8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:41:34.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.823+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1da0107bb0 con 0x7f1da007de80 2024-09-05T07:41:34.464 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.823+0000 7f1d96a00640 1 -- 172.21.15.144:0/4206917878 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1d9006b990 con 0x7f1da007de80 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.825+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 msgr2=0x7f1d8403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.825+0000 7f1d9f200640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 0x7f1d8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.825+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 msgr2=0x7f1da010a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.825+0000 7f1d9f200640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d90030ec0 comp rx=0 tx=0).stop 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 shutdown_connections 2024-09-05T07:41:34.465 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f1d84038fc0 0x7f1d8403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 --2- 172.21.15.144:0/4206917878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da007de80 0x7f1da010a6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 >> 172.21.15.144:0/4206917878 conn(0x7f1da0102c10 msgr2=0x7f1da0103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 shutdown_connections 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:33.826+0000 7f1d9f200640 1 -- 172.21.15.144:0/4206917878 wait complete. 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for the mgr to restart... 2024-09-05T07:41:34.466 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mgr epoch 5... 2024-09-05T07:41:34.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:34 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4206917878' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T07:41:35.243 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:35.162+0000 7ffbc5a36040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:41:35.243 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:35.242+0000 7ffbc5a36040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:41:36.428 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.133+0000 7ffbc5a36040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:41:36.429 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.266+0000 7ffbc5a36040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:41:36.747 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.427+0000 7ffbc5a36040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:41:36.748 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.499+0000 7ffbc5a36040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:41:36.748 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.666+0000 7ffbc5a36040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:41:36.748 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.746+0000 7ffbc5a36040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:41:37.070 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.817+0000 7ffbc5a36040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:41:37.071 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:36.994+0000 7ffbc5a36040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:41:37.071 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:37.069+0000 7ffbc5a36040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:41:37.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:37.147+0000 7ffbc5a36040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:41:37.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:37.242+0000 7ffbc5a36040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:41:37.321 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:37.311+0000 7ffbc5a36040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:41:37.821 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:37.381+0000 7ffbc5a36040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:41:38.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:38.276+0000 7ffbc5a36040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: Active manager daemon x restarted 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: Activating manager daemon x 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: osdmap e2: 0 total, 0 up, 0 in 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: mgrmap e6: x(active, starting, since 0.00384404s) 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: Manager daemon x is now available 2024-09-05T07:41:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:38.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:38.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:41:38.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:38 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:41:39.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: Found migration_current of "None". Setting to last migration. 2024-09-05T07:41:39.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T07:41:39.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T07:41:39.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:39.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:39.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-mon[29535]: mgrmap e7: x(active, since 1.00943s) 2024-09-05T07:41:40.168 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.952+0000 7f902ca00640 1 Processor -- start 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.953+0000 7f902ca00640 1 -- start start 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.953+0000 7f902ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.953+0000 7f902ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f902807be10 con 0x7f9028105d20 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.954+0000 7f9027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.954+0000 7f9027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42976/0 (socket says 172.21.15.144:42976) 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.954+0000 7f9027400640 1 -- 172.21.15.144:0/1697550905 learned_addr learned my addr 172.21.15.144:0/1697550905 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.954+0000 7f9027400640 1 -- 172.21.15.144:0/1697550905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028106660 con 0x7f9028105d20 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.955+0000 7f9027400640 1 --2- 172.21.15.144:0/1697550905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9018009820 tx=0x7f901802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f915e75cb5bd4985 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.956+0000 7f9026000640 1 -- 172.21.15.144:0/1697550905 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018037070 con 0x7f9028105d20 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.956+0000 7f9026000640 1 -- 172.21.15.144:0/1697550905 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9018032900 con 0x7f9028105d20 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.956+0000 7f9026000640 1 -- 172.21.15.144:0/1697550905 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018030850 con 0x7f9028105d20 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 -- 172.21.15.144:0/1697550905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 msgr2=0x7f9028106120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:40.170 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 --2- 172.21.15.144:0/1697550905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9018009820 tx=0x7f901802a270 comp rx=0 tx=0).stop 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 -- 172.21.15.144:0/1697550905 shutdown_connections 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 --2- 172.21.15.144:0/1697550905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f9028106120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 -- 172.21.15.144:0/1697550905 >> 172.21.15.144:0/1697550905 conn(0x7f9028101a70 msgr2=0x7f9028103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 -- 172.21.15.144:0/1697550905 shutdown_connections 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.957+0000 7f902ca00640 1 -- 172.21.15.144:0/1697550905 wait complete. 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.958+0000 7f902ca00640 1 Processor -- start 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f902ca00640 1 -- start start 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f902ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f902ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9028107760 con 0x7f9028105d20 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f9027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:40.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f9027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42992/0 (socket says 172.21.15.144:42992) 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.959+0000 7f9027400640 1 -- 172.21.15.144:0/2107461659 learned_addr learned my addr 172.21.15.144:0/2107461659 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.960+0000 7f9027400640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902819dba0 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.960+0000 7f9027400640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90180097f0 tx=0x7f9018030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.961+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018042070 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.961+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9018032ca0 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.961+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018037040 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.961+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902819de30 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.961+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90281a0b20 con 0x7f9028105d20 2024-09-05T07:41:40.172 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9018045070 con 0x7f9028105d20 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f901fe00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f900c03bb90 con 0x7f900c038fc0 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f901806bf10 con 0x7f9028105d20 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f9026a00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:34.963+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:35.164+0000 7f9026a00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:35.164+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:35.565+0000 7f9026a00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:35.565+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:36.366+0000 7f9026a00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:36.366+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:41:40.173 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:37.967+0000 7f9026a00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/3542536787 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:37.967+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:38.281+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f901803d430 con 0x7f9028105d20 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:38.281+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 msgr2=0x7f900c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:38.281+0000 7f901fe00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.285+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f901806dd50 con 0x7f9028105d20 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.285+0000 7f901fe00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 0x7f900c03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.285+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f900c03bb90 con 0x7f900c03c8f0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.286+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 0x7f900c03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.287+0000 7f9026a00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 0x7f900c03ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9014003980 tx=0x7f90140092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.288+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f900c03bb90 con 0x7f900c03c8f0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9028106120 con 0x7f900c03c8f0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f901fe00640 1 -- 172.21.15.144:0/2107461659 <== mgr.14118 v2:172.21.15.144:6800/490246891 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f9028106120 con 0x7f900c03c8f0 2024-09-05T07:41:40.174 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 msgr2=0x7f900c03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 0x7f900c03ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9014003980 tx=0x7f90140092b0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 msgr2=0x7f902819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90180097f0 tx=0x7f9018030ec0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 shutdown_connections 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f900c03c8f0 0x7f900c03ece0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:6800/3542536787,v1:172.21.15.144:6801/3542536787] conn(0x7f900c038fc0 0x7f900c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 --2- 172.21.15.144:0/2107461659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9028105d20 0x7f902819d660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.301+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 >> 172.21.15.144:0/2107461659 conn(0x7f9028101a70 msgr2=0x7f90281942c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.302+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 shutdown_connections 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:39.302+0000 7f902ca00640 1 -- 172.21.15.144:0/2107461659 wait complete. 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:mgr epoch 5 is available 2024-09-05T07:41:40.175 INFO:teuthology.orchestra.run.smithi144.stdout:Setting orchestrator backend to cephadm... 2024-09-05T07:41:40.303 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:39.920+0000 7ffb24c00640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:07:41:39] ENGINE Error in HTTPServer.serve 2024-09-05T07:41:40.303 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: Traceback (most recent call last): 2024-09-05T07:41:40.303 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T07:41:40.303 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._connections.run(self.expiration_interval) 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._run(expiration_interval) 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: s = self.context.wrap_socket( 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: return self.sslsocket_class._create( 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T07:41:40.304 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self.do_handshake() 2024-09-05T07:41:40.305 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T07:41:40.305 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._sslobj.do_handshake() 2024-09-05T07:41:40.305 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T07:41:40.305 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:40.557 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:40 smithi144 ceph-mon[29535]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-05T07:41:40.558 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:40 smithi144 ceph-mon[29535]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-05T07:41:40.558 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:40 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: [05/Sep/2024:07:41:39] ENGINE Bus STARTING 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: [05/Sep/2024:07:41:39] ENGINE Serving on https://172.21.15.144:7150 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: [05/Sep/2024:07:41:39] ENGINE Error in HTTPServer.serve 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout: Traceback (most recent call last): 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T07:41:41.420 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._connections.run(self.expiration_interval) 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._run(expiration_interval) 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: s = self.context.wrap_socket( 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: return self.sslsocket_class._create( 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T07:41:41.421 INFO:journalctl@ceph.mon.a.smithi144.stdout: self.do_handshake() 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._sslobj.do_handshake() 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: [05/Sep/2024:07:41:40] ENGINE Serving on http://172.21.15.144:8765 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: [05/Sep/2024:07:41:40] ENGINE Bus STARTED 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: mgrmap e8: x(active, since 2s) 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:41.422 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:41 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:41:41.433 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.665+0000 7f8bf5400640 1 Processor -- start 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.665+0000 7f8bf5400640 1 -- start start 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bf5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bf5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010a240 con 0x7f8bf0109870 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43078/0 (socket says 172.21.15.144:43078) 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bee800640 1 -- 172.21.15.144:0/2309727332 learned_addr learned my addr 172.21.15.144:0/2309727332 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:41.434 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.666+0000 7f8bee800640 1 -- 172.21.15.144:0/2309727332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf010aa10 con 0x7f8bf0109870 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.667+0000 7f8bee800640 1 --2- 172.21.15.144:0/2309727332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009820 tx=0x7f8be002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eec1efb042564c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bed400640 1 -- 172.21.15.144:0/2309727332 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be0037070 con 0x7f8bf0109870 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bed400640 1 -- 172.21.15.144:0/2309727332 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8be0032900 con 0x7f8bf0109870 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bed400640 1 -- 172.21.15.144:0/2309727332 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be0030850 con 0x7f8bf0109870 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 -- 172.21.15.144:0/2309727332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 msgr2=0x7f8bf0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 --2- 172.21.15.144:0/2309727332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009820 tx=0x7f8be002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 -- 172.21.15.144:0/2309727332 shutdown_connections 2024-09-05T07:41:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 --2- 172.21.15.144:0/2309727332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf0109c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 -- 172.21.15.144:0/2309727332 >> 172.21.15.144:0/2309727332 conn(0x7f8bf007cf40 msgr2=0x7f8bf007d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.668+0000 7f8bf5400640 1 -- 172.21.15.144:0/2309727332 shutdown_connections 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.669+0000 7f8bf5400640 1 -- 172.21.15.144:0/2309727332 wait complete. 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.669+0000 7f8bf5400640 1 Processor -- start 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bf5400640 1 -- start start 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bf5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bf5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010ddc0 con 0x7f8bf0109870 2024-09-05T07:41:41.436 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43080/0 (socket says 172.21.15.144:43080) 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.670+0000 7f8bee800640 1 -- 172.21.15.144:0/1169207460 learned_addr learned my addr 172.21.15.144:0/1169207460 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8bee800640 1 -- 172.21.15.144:0/1169207460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf019dd20 con 0x7f8bf0109870 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8bee800640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8be0032ce0 tx=0x7f8be0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be0042070 con 0x7f8bf0109870 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8be00308c0 con 0x7f8bf0109870 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be0037040 con 0x7f8bf0109870 2024-09-05T07:41:41.437 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf019dfb0 con 0x7f8bf0109870 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.671+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a0ca0 con 0x7f8bf0109870 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.672+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8be0045070 con 0x7f8bf0109870 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.672+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0109c70 con 0x7f8bf0109870 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.673+0000 7f8be7400640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 0x7f8bd403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.673+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8be006c090 con 0x7f8bf0109870 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.673+0000 7f8bede00640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 0x7f8bd403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.674+0000 7f8bede00640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 0x7f8bd403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0098c0 tx=0x7f8bdc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:41.438 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.678+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8be004b170 con 0x7f8bf0109870 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.867+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f8bf0107b90 con 0x7f8bd4038f70 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.873+0000 7f8be7400640 1 -- 172.21.15.144:0/1169207460 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bf0107b90 con 0x7f8bd4038f70 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 msgr2=0x7f8bd403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 0x7f8bd403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0098c0 tx=0x7f8bdc006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 msgr2=0x7f8bf019d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8be0032ce0 tx=0x7f8be0032d10 comp rx=0 tx=0).stop 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 shutdown_connections 2024-09-05T07:41:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f8bd4038f70 0x7f8bd403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:41.440 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 --2- 172.21.15.144:0/1169207460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bf0109870 0x7f8bf019d7e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:41.440 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 >> 172.21.15.144:0/1169207460 conn(0x7f8bf007cf40 msgr2=0x7f8bf0107480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:41.440 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 shutdown_connections 2024-09-05T07:41:41.440 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:40.876+0000 7f8bf5400640 1 -- 172.21.15.144:0/1169207460 wait complete. 2024-09-05T07:41:42.381 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:42 smithi144 ceph-mon[29535]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:42.745 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-05T07:41:42.745 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.909+0000 7f4c63200640 1 Processor -- start 2024-09-05T07:41:42.745 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c63200640 1 -- start start 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c63200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c63200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64107e10 con 0x7f4c64107440 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43094/0 (socket says 172.21.15.144:43094) 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.910+0000 7f4c61e00640 1 -- 172.21.15.144:0/3819139018 learned_addr learned my addr 172.21.15.144:0/3819139018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.911+0000 7f4c61e00640 1 -- 172.21.15.144:0/3819139018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c64108640 con 0x7f4c64107440 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c61e00640 1 --2- 172.21.15.144:0/3819139018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009820 tx=0x7f4c5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fb485f70ae2f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c61400640 1 -- 172.21.15.144:0/3819139018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54037070 con 0x7f4c64107440 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c61400640 1 -- 172.21.15.144:0/3819139018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c54032900 con 0x7f4c64107440 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c61400640 1 -- 172.21.15.144:0/3819139018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54030850 con 0x7f4c64107440 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c63200640 1 -- 172.21.15.144:0/3819139018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 msgr2=0x7f4c64107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:42.746 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.912+0000 7f4c63200640 1 --2- 172.21.15.144:0/3819139018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009820 tx=0x7f4c5402a270 comp rx=0 tx=0).stop 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.913+0000 7f4c63200640 1 -- 172.21.15.144:0/3819139018 shutdown_connections 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.913+0000 7f4c63200640 1 --2- 172.21.15.144:0/3819139018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c64107840 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.913+0000 7f4c63200640 1 -- 172.21.15.144:0/3819139018 >> 172.21.15.144:0/3819139018 conn(0x7f4c64102c10 msgr2=0x7f4c64105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.913+0000 7f4c63200640 1 -- 172.21.15.144:0/3819139018 shutdown_connections 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.913+0000 7f4c63200640 1 -- 172.21.15.144:0/3819139018 wait complete. 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c63200640 1 Processor -- start 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c63200640 1 -- start start 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c63200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c63200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6410b9f0 con 0x7f4c64107440 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43108/0 (socket says 172.21.15.144:43108) 2024-09-05T07:41:42.747 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.914+0000 7f4c61e00640 1 -- 172.21.15.144:0/1867093089 learned_addr learned my addr 172.21.15.144:0/1867093089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c61e00640 1 -- 172.21.15.144:0/1867093089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6419ba10 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c61e00640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097f0 tx=0x7f4c54030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54042070 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c54032ca0 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6419bca0 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54037040 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.915+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6419e990 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.917+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4c54045070 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.917+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6410bb70 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.917+0000 7f4c5aa00640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 0x7f4c4803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.917+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c5406bf50 con 0x7f4c64107440 2024-09-05T07:41:42.748 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.917+0000 7f4c5be00640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 0x7f4c4803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.918+0000 7f4c5be00640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 0x7f4c4803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098c0 tx=0x7f4c4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:41.922+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c5406b8a0 con 0x7f4c64107440 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.098+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f4c64103ee0 con 0x7f4c48038fc0 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.099+0000 7f4c5aa00640 1 -- 172.21.15.144:0/1867093089 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f4c64103ee0 con 0x7f4c48038fc0 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.101+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 msgr2=0x7f4c4803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.101+0000 7f4c63200640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 0x7f4c4803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098c0 tx=0x7f4c4c006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.101+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 msgr2=0x7f4c6419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.101+0000 7f4c63200640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097f0 tx=0x7f4c54030ec0 comp rx=0 tx=0).stop 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 shutdown_connections 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f4c48038fc0 0x7f4c4803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 --2- 172.21.15.144:0/1867093089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c64107440 0x7f4c6419b4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:42.749 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 >> 172.21.15.144:0/1867093089 conn(0x7f4c64102c10 msgr2=0x7f4c641037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:42.750 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 shutdown_connections 2024-09-05T07:41:42.750 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:42.102+0000 7f4c63200640 1 -- 172.21.15.144:0/1867093089 wait complete. 2024-09-05T07:41:42.750 INFO:teuthology.orchestra.run.smithi144.stdout:Generating ssh key... 2024-09-05T07:41:43.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-mon[29535]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:43.816 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: Generating public/private rsa key pair. 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: Your identification has been saved in /tmp/tmpi91gwqy9/key 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: Your public key has been saved in /tmp/tmpi91gwqy9/key.pub 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: The key fingerprint is: 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: SHA256:OiD/ZslbYRePKs9Xb0ypJ32JNRNu3OpNeLZTSSP4dCM ceph-17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: The key's randomart image is: 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: +---[RSA 3072]----+ 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | | 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | | 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | . . | 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | = E * | 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | . . S o + B.*| 2024-09-05T07:41:43.817 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | o . o + ..oXo| 2024-09-05T07:41:43.818 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | ..+.o . *=.O| 2024-09-05T07:41:43.818 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | .=* . o.BBo| 2024-09-05T07:41:43.818 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: | oo.o. =.oo| 2024-09-05T07:41:43.818 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: +----[SHA256]-----+ 2024-09-05T07:41:44.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa4800640 1 Processor -- start 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa4800640 1 -- start start 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c10a310 con 0x7f0a9c109920 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54882/0 (socket says 172.21.15.144:54882) 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.207+0000 7f0aa1e00640 1 -- 172.21.15.144:0/1726303491 learned_addr learned my addr 172.21.15.144:0/1726303491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.208+0000 7f0aa1e00640 1 -- 172.21.15.144:0/1726303491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c10aa10 con 0x7f0a9c109920 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.209+0000 7f0aa1e00640 1 --2- 172.21.15.144:0/1726303491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009820 tx=0x7f0a9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f84adfc616a004 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.209+0000 7f0aa0a00640 1 -- 172.21.15.144:0/1726303491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a90037070 con 0x7f0a9c109920 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.209+0000 7f0aa0a00640 1 -- 172.21.15.144:0/1726303491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a90032900 con 0x7f0a9c109920 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.209+0000 7f0aa0a00640 1 -- 172.21.15.144:0/1726303491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a90030850 con 0x7f0a9c109920 2024-09-05T07:41:44.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 -- 172.21.15.144:0/1726303491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 msgr2=0x7f0a9c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 --2- 172.21.15.144:0/1726303491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009820 tx=0x7f0a9002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 -- 172.21.15.144:0/1726303491 shutdown_connections 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 --2- 172.21.15.144:0/1726303491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c109d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 -- 172.21.15.144:0/1726303491 >> 172.21.15.144:0/1726303491 conn(0x7f0a9c07cf40 msgr2=0x7f0a9c07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 -- 172.21.15.144:0/1726303491 shutdown_connections 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.210+0000 7f0aa4800640 1 -- 172.21.15.144:0/1726303491 wait complete. 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa4800640 1 Processor -- start 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa4800640 1 -- start start 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c10ddc0 con 0x7f0a9c109920 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54894/0 (socket says 172.21.15.144:54894) 2024-09-05T07:41:44.076 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.211+0000 7f0aa1e00640 1 -- 172.21.15.144:0/2698634641 learned_addr learned my addr 172.21.15.144:0/2698634641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0aa1e00640 1 -- 172.21.15.144:0/2698634641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c19dd70 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0aa1e00640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a900097f0 tx=0x7f0a90030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a90037040 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a90040070 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c19e000 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a9003a390 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.212+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c1a0cf0 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.213+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0a90032900 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.214+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9c109dc0 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.214+0000 7f0a96a00640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 0x7f0a8403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.214+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0a9006c540 con 0x7f0a9c109920 2024-09-05T07:41:44.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.214+0000 7f0aa1400640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 0x7f0a8403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.215+0000 7f0aa1400640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 0x7f0a8403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0098c0 tx=0x7f0a8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.219+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a9006be90 con 0x7f0a9c109920 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.396+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0a9c107c50 con 0x7f0a84038f70 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.498+0000 7f0a96a00640 1 -- 172.21.15.144:0/2698634641 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a9c107c50 con 0x7f0a84038f70 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 msgr2=0x7f0a8403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 0x7f0a8403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0098c0 tx=0x7f0a8c006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 msgr2=0x7f0a9c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a900097f0 tx=0x7f0a90030d80 comp rx=0 tx=0).stop 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 shutdown_connections 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0a84038f70 0x7f0a8403b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 --2- 172.21.15.144:0/2698634641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a9c109920 0x7f0a9c19d830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.500+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 >> 172.21.15.144:0/2698634641 conn(0x7f0a9c07cf40 msgr2=0x7f0a9c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:44.078 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.501+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 shutdown_connections 2024-09-05T07:41:44.079 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:43.501+0000 7f0aa4800640 1 -- 172.21.15.144:0/2698634641 wait complete. 2024-09-05T07:41:44.576 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:44 smithi144 ceph-mon[29535]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:44.576 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:44 smithi144 ceph-mon[29535]: Generating ssh key... 2024-09-05T07:41:44.577 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:44 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:44.577 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:44 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:45.503 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:41:45.514 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.599+0000 7fa55d800640 1 Processor -- start 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa55d800640 1 -- start start 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa55d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa55d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa55807c840 con 0x7fa55807de00 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa557e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa557e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54908/0 (socket says 172.21.15.144:54908) 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.600+0000 7fa557e00640 1 -- 172.21.15.144:0/1989763711 learned_addr learned my addr 172.21.15.144:0/1989763711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.601+0000 7fa557e00640 1 -- 172.21.15.144:0/1989763711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55807c9c0 con 0x7fa55807de00 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa557e00640 1 --2- 172.21.15.144:0/1989763711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa548009820 tx=0x7fa54802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcb831becee07ea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa557400640 1 -- 172.21.15.144:0/1989763711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548037070 con 0x7fa55807de00 2024-09-05T07:41:45.515 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa557400640 1 -- 172.21.15.144:0/1989763711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa548032900 con 0x7fa55807de00 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa557400640 1 -- 172.21.15.144:0/1989763711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548030850 con 0x7fa55807de00 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa55d800640 1 -- 172.21.15.144:0/1989763711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 msgr2=0x7fa55807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.602+0000 7fa55d800640 1 --2- 172.21.15.144:0/1989763711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa548009820 tx=0x7fa54802a270 comp rx=0 tx=0).stop 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.603+0000 7fa55d800640 1 -- 172.21.15.144:0/1989763711 shutdown_connections 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.603+0000 7fa55d800640 1 --2- 172.21.15.144:0/1989763711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55807c300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.603+0000 7fa55d800640 1 -- 172.21.15.144:0/1989763711 >> 172.21.15.144:0/1989763711 conn(0x7fa558102d00 msgr2=0x7fa558105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.603+0000 7fa55d800640 1 -- 172.21.15.144:0/1989763711 shutdown_connections 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.603+0000 7fa55d800640 1 -- 172.21.15.144:0/1989763711 wait complete. 2024-09-05T07:41:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa55d800640 1 Processor -- start 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa55d800640 1 -- start start 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa55d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa55d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810daa0 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa557e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa557e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54916/0 (socket says 172.21.15.144:54916) 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.604+0000 7fa557e00640 1 -- 172.21.15.144:0/3051461101 learned_addr learned my addr 172.21.15.144:0/3051461101 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa557e00640 1 -- 172.21.15.144:0/3051461101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55819dbc0 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa557e00640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa548031000 tx=0x7fa5480326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548042070 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa548032be0 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548037040 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55819de50 con 0x7fa55807de00 2024-09-05T07:41:45.517 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.605+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581a0b40 con 0x7fa55807de00 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.606+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa548045070 con 0x7fa55807de00 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.606+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55807c380 con 0x7fa55807de00 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.607+0000 7fa555600640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 0x7fa53c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.607+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa54806c010 con 0x7fa55807de00 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.607+0000 7fa54fe00640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 0x7fa53c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.608+0000 7fa54fe00640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 0x7fa53c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5400098c0 tx=0x7fa540006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.612+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa54802f2a0 con 0x7fa55807de00 2024-09-05T07:41:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.786+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fa558103fc0 con 0x7fa53c038fc0 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.787+0000 7fa555600640 1 -- 172.21.15.144:0/3051461101 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fa558103fc0 con 0x7fa53c038fc0 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 msgr2=0x7fa53c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 0x7fa53c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5400098c0 tx=0x7fa540006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 msgr2=0x7fa55819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa548031000 tx=0x7fa5480326e0 comp rx=0 tx=0).stop 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 shutdown_connections 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fa53c038fc0 0x7fa53c03b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:45.519 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 --2- 172.21.15.144:0/3051461101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55807de00 0x7fa55819d680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.789+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 >> 172.21.15.144:0/3051461101 conn(0x7fa558102d00 msgr2=0x7fa5581038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.790+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 shutdown_connections 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:44.790+0000 7fa55d800640 1 -- 172.21.15.144:0/3051461101 wait complete. 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:Adding key to root@localhost authorized_keys... 2024-09-05T07:41:45.520 INFO:teuthology.orchestra.run.smithi144.stdout:Adding host smithi144... 2024-09-05T07:41:45.759 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:45 smithi144 ceph-mon[29535]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:46.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:46 smithi144 ceph-mon[29535]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "addr": "172.21.15.144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:47.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:47 smithi144 ceph-mon[29535]: Deploying cephadm binary to smithi144 2024-09-05T07:41:50.604 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout Added host 'smithi144' with addr '172.21.15.144' 2024-09-05T07:41:50.604 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa6400640 1 Processor -- start 2024-09-05T07:41:50.604 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa6400640 1 -- start start 2024-09-05T07:41:50.604 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa0107e10 con 0x7f0fa0107440 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54926/0 (socket says 172.21.15.144:54926) 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.966+0000 7f0fa5000640 1 -- 172.21.15.144:0/2621760842 learned_addr learned my addr 172.21.15.144:0/2621760842 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.967+0000 7f0fa5000640 1 -- 172.21.15.144:0/2621760842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa0108640 con 0x7f0fa0107440 2024-09-05T07:41:50.605 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0fa5000640 1 --2- 172.21.15.144:0/2621760842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009e80 tx=0x7f0f9402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bde49882e2493 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0f9f400640 1 -- 172.21.15.144:0/2621760842 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f94036070 con 0x7f0fa0107440 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0f9f400640 1 -- 172.21.15.144:0/2621760842 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f940318c0 con 0x7f0fa0107440 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0f9f400640 1 -- 172.21.15.144:0/2621760842 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f94007ab0 con 0x7f0fa0107440 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0fa6400640 1 -- 172.21.15.144:0/2621760842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 msgr2=0x7f0fa0107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.968+0000 7f0fa6400640 1 --2- 172.21.15.144:0/2621760842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009e80 tx=0x7f0f9402a7a0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 -- 172.21.15.144:0/2621760842 shutdown_connections 2024-09-05T07:41:50.610 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 --2- 172.21.15.144:0/2621760842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa0107840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 -- 172.21.15.144:0/2621760842 >> 172.21.15.144:0/2621760842 conn(0x7f0fa0102c10 msgr2=0x7f0fa0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 -- 172.21.15.144:0/2621760842 shutdown_connections 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 -- 172.21.15.144:0/2621760842 wait complete. 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.969+0000 7f0fa6400640 1 Processor -- start 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa6400640 1 -- start start 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010b9f0 con 0x7f0fa0107440 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54942/0 (socket says 172.21.15.144:54942) 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa5000640 1 -- 172.21.15.144:0/3014319223 learned_addr learned my addr 172.21.15.144:0/3014319223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.970+0000 7f0fa5000640 1 -- 172.21.15.144:0/3014319223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa019dc50 con 0x7f0fa0107440 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0fa5000640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f9402acc0 tx=0x7f0f94031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:50.611 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f94036050 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f94037040 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa019dee0 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9403d890 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.971+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa01a0bd0 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.972+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0f94044020 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.972+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa010bb70 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.973+0000 7f0f9d600640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 0x7f0f8803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.973+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f94042020 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.973+0000 7f0f9fe00640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 0x7f0f8803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.974+0000 7f0f9fe00640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 0x7f0f8803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0098c0 tx=0x7f0f8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:45.978+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f9404b020 con 0x7f0fa0107440 2024-09-05T07:41:50.612 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:46.156+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi144", "addr": "172.21.15.144", "target": ["mon-mgr", ""]}) -- 0x7f0fa0103eb0 con 0x7f0f88038fc0 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.993+0000 7f0f9d600640 1 -- 172.21.15.144:0/3014319223 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f0fa0103eb0 con 0x7f0f88038fc0 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 msgr2=0x7f0f8803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 0x7f0f8803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0098c0 tx=0x7f0f8c006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 msgr2=0x7f0fa019d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f9402acc0 tx=0x7f0f94031ca0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 shutdown_connections 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f0f88038fc0 0x7f0f8803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 --2- 172.21.15.144:0/3014319223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0107440 0x7f0fa019d710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 >> 172.21.15.144:0/3014319223 conn(0x7f0fa0102c10 msgr2=0x7f0fa01037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 shutdown_connections 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:49.996+0000 7f0fa6400640 1 -- 172.21.15.144:0/3014319223 wait complete. 2024-09-05T07:41:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:Deploying unmanaged mon service... 2024-09-05T07:41:51.270 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:50 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:51.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:50 smithi144 ceph-mon[29535]: Added host smithi144 2024-09-05T07:41:51.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:50 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:41:52.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:52 smithi144 ceph-mon[29535]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:52.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:52 smithi144 ceph-mon[29535]: Saving service mon spec with placement count:5 2024-09-05T07:41:52.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:52 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.269+0000 7f9fc5c00640 1 Processor -- start 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.269+0000 7f9fc5c00640 1 -- start start 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.270+0000 7f9fc5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.270+0000 7f9fc5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc007c860 con 0x7f9fc007ddb0 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.270+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:53.082 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.270+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54944/0 (socket says 172.21.15.144:54944) 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.270+0000 7f9fbea00640 1 -- 172.21.15.144:0/1141264087 learned_addr learned my addr 172.21.15.144:0/1141264087 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.271+0000 7f9fbea00640 1 -- 172.21.15.144:0/1141264087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc007c9e0 con 0x7f9fc007ddb0 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.272+0000 7f9fbea00640 1 --2- 172.21.15.144:0/1141264087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009820 tx=0x7f9fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72f7abd3f8b3c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.272+0000 7f9fbd600640 1 -- 172.21.15.144:0/1141264087 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0037070 con 0x7f9fc007ddb0 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.272+0000 7f9fbd600640 1 -- 172.21.15.144:0/1141264087 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fb0032900 con 0x7f9fc007ddb0 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.272+0000 7f9fbd600640 1 -- 172.21.15.144:0/1141264087 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0030850 con 0x7f9fc007ddb0 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1141264087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 msgr2=0x7f9fc007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1141264087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009820 tx=0x7f9fb002a270 comp rx=0 tx=0).stop 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1141264087 shutdown_connections 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1141264087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc007c320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1141264087 >> 172.21.15.144:0/1141264087 conn(0x7f9fc0102eb0 msgr2=0x7f9fc01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:53.083 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1141264087 shutdown_connections 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.273+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1141264087 wait complete. 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.274+0000 7f9fc5c00640 1 Processor -- start 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.274+0000 7f9fc5c00640 1 -- start start 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.274+0000 7f9fc5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.274+0000 7f9fc5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc010dbe0 con 0x7f9fc007ddb0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.275+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.275+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54960/0 (socket says 172.21.15.144:54960) 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.275+0000 7f9fbea00640 1 -- 172.21.15.144:0/1360696108 learned_addr learned my addr 172.21.15.144:0/1360696108 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.275+0000 7f9fbea00640 1 -- 172.21.15.144:0/1360696108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc019ddd0 con 0x7f9fc007ddb0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.275+0000 7f9fbea00640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00097f0 tx=0x7f9fb0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.276+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0042070 con 0x7f9fc007ddb0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.276+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fb0032ca0 con 0x7f9fc007ddb0 2024-09-05T07:41:53.084 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.276+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc019e060 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.276+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0037040 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.276+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc01a0d50 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.277+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9fb0045070 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.277+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc007c3a0 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.277+0000 7f9fb7400640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 0x7f9fa403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.277+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9fb006c020 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.277+0000 7f9fbe000640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 0x7f9fa403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.278+0000 7f9fbe000640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 0x7f9fa403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0098c0 tx=0x7f9fac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.282+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fb0045360 con 0x7f9fc007ddb0 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.493+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9fc0104190 con 0x7f9fa4038f70 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.498+0000 7f9fb7400640 1 -- 172.21.15.144:0/1360696108 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9fc0104190 con 0x7f9fa4038f70 2024-09-05T07:41:53.085 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 msgr2=0x7f9fa403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 0x7f9fa403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0098c0 tx=0x7f9fac006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 msgr2=0x7f9fc019d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00097f0 tx=0x7f9fb0030ec0 comp rx=0 tx=0).stop 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 shutdown_connections 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9fa4038f70 0x7f9fa403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 --2- 172.21.15.144:0/1360696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc007ddb0 0x7f9fc019d890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.500+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 >> 172.21.15.144:0/1360696108 conn(0x7f9fc0102eb0 msgr2=0x7f9fc0103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.501+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 shutdown_connections 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:51.501+0000 7f9fc5c00640 1 -- 172.21.15.144:0/1360696108 wait complete. 2024-09-05T07:41:53.086 INFO:teuthology.orchestra.run.smithi144.stdout:Deploying unmanaged mgr service... 2024-09-05T07:41:54.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:53 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:54.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:53 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:55.188 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:54 smithi144 ceph-mon[29535]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:41:55.188 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:54 smithi144 ceph-mon[29535]: Saving service mgr spec with placement count:2 2024-09-05T07:41:55.188 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:54 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.668+0000 7fe0e8e00640 1 Processor -- start 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.668+0000 7fe0e8e00640 1 -- start start 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.669+0000 7fe0e8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.669+0000 7fe0e8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4107fc0 con 0x7fe0e4107680 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.669+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.669+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60558/0 (socket says 172.21.15.144:60558) 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.669+0000 7fe0e1e00640 1 -- 172.21.15.144:0/2449570566 learned_addr learned my addr 172.21.15.144:0/2449570566 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.670+0000 7fe0e1e00640 1 -- 172.21.15.144:0/2449570566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e4108140 con 0x7fe0e4107680 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e1e00640 1 --2- 172.21.15.144:0/2449570566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009820 tx=0x7fe0d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06d57a2f37786df server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e1400640 1 -- 172.21.15.144:0/2449570566 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x7fe0e4107680 2024-09-05T07:41:55.198 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e1400640 1 -- 172.21.15.144:0/2449570566 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0d4032920 con 0x7fe0e4107680 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e1400640 1 -- 172.21.15.144:0/2449570566 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4030810 con 0x7fe0e4107680 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e8e00640 1 -- 172.21.15.144:0/2449570566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 msgr2=0x7fe0e4107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.671+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/2449570566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009820 tx=0x7fe0d402a270 comp rx=0 tx=0).stop 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 -- 172.21.15.144:0/2449570566 shutdown_connections 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/2449570566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e4107a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 -- 172.21.15.144:0/2449570566 >> 172.21.15.144:0/2449570566 conn(0x7fe0e4102eb0 msgr2=0x7fe0e41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 -- 172.21.15.144:0/2449570566 shutdown_connections 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 -- 172.21.15.144:0/2449570566 wait complete. 2024-09-05T07:41:55.199 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.672+0000 7fe0e8e00640 1 Processor -- start 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e8e00640 1 -- start start 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e410baf0 con 0x7fe0e4107680 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60560/0 (socket says 172.21.15.144:60560) 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e1e00640 1 -- 172.21.15.144:0/3066220258 learned_addr learned my addr 172.21.15.144:0/3066220258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.673+0000 7fe0e1e00640 1 -- 172.21.15.144:0/3066220258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e407e0b0 con 0x7fe0e4107680 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0e1e00640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40097f0 tx=0x7fe0d40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037040 con 0x7fe0e4107680 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e407c2a0 con 0x7fe0e4107680 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0d4030c40 con 0x7fe0e4107680 2024-09-05T07:41:55.200 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d403a5d0 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.674+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e407c7e0 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.675+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe0d403b3f0 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.675+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e4107b00 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.676+0000 7fe0db400640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 0x7fe0c803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.676+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe0d406c4f0 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.676+0000 7fe0d9400640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 0x7fe0c803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.677+0000 7fe0d9400640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 0x7fe0c803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0098c0 tx=0x7fe0cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.681+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0d40371e0 con 0x7fe0e4107680 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.883+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe0e407d130 con 0x7fe0c8038fc0 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.888+0000 7fe0db400640 1 -- 172.21.15.144:0/3066220258 <== mgr.14118 v2:172.21.15.144:6800/490246891 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe0e407d130 con 0x7fe0c8038fc0 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 msgr2=0x7fe0c803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 0x7fe0c803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0098c0 tx=0x7fe0cc006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:55.201 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 msgr2=0x7fe0e407db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40097f0 tx=0x7fe0d40327b0 comp rx=0 tx=0).stop 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 shutdown_connections 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fe0c8038fc0 0x7fe0c803b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 --2- 172.21.15.144:0/3066220258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e4107680 0x7fe0e407db70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 >> 172.21.15.144:0/3066220258 conn(0x7fe0e4102eb0 msgr2=0x7fe0e4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 shutdown_connections 2024-09-05T07:41:55.202 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:53.891+0000 7fe0e8e00640 1 -- 172.21.15.144:0/3066220258 wait complete. 2024-09-05T07:41:56.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:56 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:56.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:56 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3660787351' entity='client.admin' 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.756+0000 7fd72f800640 1 Processor -- start 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.757+0000 7fd72f800640 1 -- start start 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.757+0000 7fd72f800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.757+0000 7fd72f800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd72810a310 con 0x7fd728109920 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.757+0000 7fd72ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.758+0000 7fd72ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60570/0 (socket says 172.21.15.144:60570) 2024-09-05T07:41:56.706 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.758+0000 7fd72ce00640 1 -- 172.21.15.144:0/2308607085 learned_addr learned my addr 172.21.15.144:0/2308607085 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.758+0000 7fd72ce00640 1 -- 172.21.15.144:0/2308607085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72810aa10 con 0x7fd728109920 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.759+0000 7fd72ce00640 1 --2- 172.21.15.144:0/2308607085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009820 tx=0x7fd71c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0600ddd02dfd12c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.759+0000 7fd727400640 1 -- 172.21.15.144:0/2308607085 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd71c037070 con 0x7fd728109920 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.759+0000 7fd727400640 1 -- 172.21.15.144:0/2308607085 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd71c032920 con 0x7fd728109920 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.759+0000 7fd727400640 1 -- 172.21.15.144:0/2308607085 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd71c030810 con 0x7fd728109920 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 -- 172.21.15.144:0/2308607085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 msgr2=0x7fd728109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 --2- 172.21.15.144:0/2308607085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009820 tx=0x7fd71c02a270 comp rx=0 tx=0).stop 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 -- 172.21.15.144:0/2308607085 shutdown_connections 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 --2- 172.21.15.144:0/2308607085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd728109d40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 -- 172.21.15.144:0/2308607085 >> 172.21.15.144:0/2308607085 conn(0x7fd72807cf40 msgr2=0x7fd72807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 -- 172.21.15.144:0/2308607085 shutdown_connections 2024-09-05T07:41:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.760+0000 7fd72f800640 1 -- 172.21.15.144:0/2308607085 wait complete. 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.761+0000 7fd72f800640 1 Processor -- start 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.761+0000 7fd72f800640 1 -- start start 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72f800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72f800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd72810ddc0 con 0x7fd728109920 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60572/0 (socket says 172.21.15.144:60572) 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72ce00640 1 -- 172.21.15.144:0/3660787351 learned_addr learned my addr 172.21.15.144:0/3660787351 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.762+0000 7fd72ce00640 1 -- 172.21.15.144:0/3660787351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72819dd70 con 0x7fd728109920 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd72ce00640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0097f0 tx=0x7fd71c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd71c037040 con 0x7fd728109920 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd71c030cc0 con 0x7fd728109920 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd71c03a640 con 0x7fd728109920 2024-09-05T07:41:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72819e000 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.763+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7281a0cf0 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.764+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72810df40 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.764+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd71c03b3f0 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.765+0000 7fd725600640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 0x7fd71003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.765+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd71c06c570 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.765+0000 7fd727e00640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 0x7fd71003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.766+0000 7fd727e00640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 0x7fd71003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7140098c0 tx=0x7fd714006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.770+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd71c042e10 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.970+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd728109dc0 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.973+0000 7fd725600640 1 -- 172.21.15.144:0/3660787351 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fd71c0328c0 con 0x7fd728109920 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 msgr2=0x7fd71003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 0x7fd71003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7140098c0 tx=0x7fd714006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:56.709 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 msgr2=0x7fd72819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0097f0 tx=0x7fd71c0327b0 comp rx=0 tx=0).stop 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 shutdown_connections 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd710038fc0 0x7fd71003b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 --2- 172.21.15.144:0/3660787351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd728109920 0x7fd72819d830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.975+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 >> 172.21.15.144:0/3660787351 conn(0x7fd72807cf40 msgr2=0x7fd728107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.976+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 shutdown_connections 2024-09-05T07:41:56.710 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:55.976+0000 7fd72f800640 1 -- 172.21.15.144:0/3660787351 wait complete. 2024-09-05T07:41:58.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:57 smithi144 ceph-mon[29535]: from='mgr.14118 172.21.15.144:0/2650639030' entity='mgr.x' 2024-09-05T07:41:58.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:57 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3595681893' entity='client.admin' 2024-09-05T07:41:58.071 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd761600640 1 Processor -- start 2024-09-05T07:41:58.071 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd761600640 1 -- start start 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd761600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd761600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c07be30 con 0x7fd75c105d00 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60588/0 (socket says 172.21.15.144:60588) 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.146+0000 7fd75be00640 1 -- 172.21.15.144:0/469192206 learned_addr learned my addr 172.21.15.144:0/469192206 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.147+0000 7fd75be00640 1 -- 172.21.15.144:0/469192206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c106640 con 0x7fd75c105d00 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.148+0000 7fd75be00640 1 --2- 172.21.15.144:0/469192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009820 tx=0x7fd74c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6abcb81370df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.148+0000 7fd75aa00640 1 -- 172.21.15.144:0/469192206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74c037070 con 0x7fd75c105d00 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.148+0000 7fd75aa00640 1 -- 172.21.15.144:0/469192206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd74c032920 con 0x7fd75c105d00 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.148+0000 7fd75aa00640 1 -- 172.21.15.144:0/469192206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74c030810 con 0x7fd75c105d00 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 -- 172.21.15.144:0/469192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 msgr2=0x7fd75c106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:58.072 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 --2- 172.21.15.144:0/469192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009820 tx=0x7fd74c02a270 comp rx=0 tx=0).stop 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 -- 172.21.15.144:0/469192206 shutdown_connections 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 --2- 172.21.15.144:0/469192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c106100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 -- 172.21.15.144:0/469192206 >> 172.21.15.144:0/469192206 conn(0x7fd75c101a70 msgr2=0x7fd75c103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 -- 172.21.15.144:0/469192206 shutdown_connections 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.149+0000 7fd761600640 1 -- 172.21.15.144:0/469192206 wait complete. 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.150+0000 7fd761600640 1 Processor -- start 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.150+0000 7fd761600640 1 -- start start 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.150+0000 7fd761600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.150+0000 7fd761600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c107780 con 0x7fd75c105d00 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60598/0 (socket says 172.21.15.144:60598) 2024-09-05T07:41:58.073 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd75be00640 1 -- 172.21.15.144:0/3595681893 learned_addr learned my addr 172.21.15.144:0/3595681893 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd75be00640 1 -- 172.21.15.144:0/3595681893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c19dba0 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd75be00640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0097f0 tx=0x7fd74c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.151+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74c037040 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.152+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd74c030c40 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.152+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c19de30 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.152+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74c03a5d0 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.152+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c1a0b20 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.153+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd74c03a7c0 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.153+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c106100 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.154+0000 7fd758c00640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 0x7fd74003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.154+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd74c06c5e0 con 0x7fd75c105d00 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.154+0000 7fd75b400640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 0x7fd74003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.155+0000 7fd75b400640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 0x7fd74003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7480098c0 tx=0x7fd748006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:41:58.074 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.159+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd74c0392f0 con 0x7fd75c105d00 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.342+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd75c196ad0 con 0x7fd75c105d00 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.344+0000 7fd758c00640 1 -- 172.21.15.144:0/3595681893 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd74c06bf70 con 0x7fd75c105d00 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 msgr2=0x7fd74003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 0x7fd74003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7480098c0 tx=0x7fd748006db0 comp rx=0 tx=0).stop 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 msgr2=0x7fd75c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0097f0 tx=0x7fd74c0327b0 comp rx=0 tx=0).stop 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 shutdown_connections 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fd740038fc0 0x7fd74003b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 --2- 172.21.15.144:0/3595681893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd75c105d00 0x7fd75c19d660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 >> 172.21.15.144:0/3595681893 conn(0x7fd75c101a70 msgr2=0x7fd75c191960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 shutdown_connections 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:57.347+0000 7fd761600640 1 -- 172.21.15.144:0/3595681893 wait complete. 2024-09-05T07:41:58.075 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling the dashboard module... 2024-09-05T07:41:59.535 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-mon[29535]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:41:59.535 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2544439684' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-05T07:41:59.535 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ignoring --setuser ceph since I am not root 2024-09-05T07:41:59.535 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ignoring --setgroup ceph since I am not root 2024-09-05T07:41:59.536 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:59.534+0000 7fa831692040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:41:59.792 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:59.607+0000 7fa831692040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:41:59.792 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:59.790+0000 7fa831692040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:42:00.044 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:41:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:41:59.870+0000 7fa831692040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:42:00.044 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:00.043+0000 7fa831692040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:42:00.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.992+0000 7f3d99a00640 1 Processor -- start 2024-09-05T07:42:00.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.992+0000 7f3d99a00640 1 -- start start 2024-09-05T07:42:00.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.992+0000 7f3d99a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:00.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.992+0000 7f3d99a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9407bde0 con 0x7f3d94105f00 2024-09-05T07:42:00.188 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.993+0000 7f3d92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.993+0000 7f3d92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60604/0 (socket says 172.21.15.144:60604) 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.993+0000 7f3d92a00640 1 -- 172.21.15.144:0/240734376 learned_addr learned my addr 172.21.15.144:0/240734376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.993+0000 7f3d92a00640 1 -- 172.21.15.144:0/240734376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d94106840 con 0x7f3d94105f00 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.994+0000 7f3d92a00640 1 --2- 172.21.15.144:0/240734376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009820 tx=0x7f3d8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32adc899941d766 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.994+0000 7f3d91600640 1 -- 172.21.15.144:0/240734376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84037070 con 0x7f3d94105f00 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.994+0000 7f3d91600640 1 -- 172.21.15.144:0/240734376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d84032920 con 0x7f3d94105f00 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.994+0000 7f3d91600640 1 -- 172.21.15.144:0/240734376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84030810 con 0x7f3d94105f00 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 -- 172.21.15.144:0/240734376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 msgr2=0x7f3d94106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 --2- 172.21.15.144:0/240734376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009820 tx=0x7f3d8402a270 comp rx=0 tx=0).stop 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 -- 172.21.15.144:0/240734376 shutdown_connections 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 --2- 172.21.15.144:0/240734376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d94106300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 -- 172.21.15.144:0/240734376 >> 172.21.15.144:0/240734376 conn(0x7f3d94101cd0 msgr2=0x7f3d941040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 -- 172.21.15.144:0/240734376 shutdown_connections 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.995+0000 7f3d99a00640 1 -- 172.21.15.144:0/240734376 wait complete. 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.996+0000 7f3d99a00640 1 Processor -- start 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.996+0000 7f3d99a00640 1 -- start start 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d99a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d99a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94107800 con 0x7f3d94105f00 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60618/0 (socket says 172.21.15.144:60618) 2024-09-05T07:42:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d92a00640 1 -- 172.21.15.144:0/2544439684 learned_addr learned my addr 172.21.15.144:0/2544439684 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d92a00640 1 -- 172.21.15.144:0/2544439684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9419dd00 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.997+0000 7f3d92a00640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097f0 tx=0x7f3d840327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.998+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84037040 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.998+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d84030cc0 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.998+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8403a6b0 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.998+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9419df90 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.998+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d941a0c80 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.999+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3d8403baf0 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.999+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94107eb0 con 0x7f3d94105f00 2024-09-05T07:42:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.999+0000 7f3d8b400640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 0x7f3d7803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:58.999+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3d8406c570 con 0x7f3d94105f00 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.000+0000 7f3d92000640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 0x7f3d7803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.000+0000 7f3d92000640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 0x7f3d7803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d800098c0 tx=0x7f3d80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.004+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d84042dc0 con 0x7f3d94105f00 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.230+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3d9402d9a0 con 0x7f3d94105f00 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.289+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3d8406bec0 con 0x7f3d94105f00 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.291+0000 7f3d8b400640 1 -- 172.21.15.144:0/2544439684 <== mon.0 v2:172.21.15.144:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f3d8403a850 con 0x7f3d94105f00 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 msgr2=0x7f3d7803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 0x7f3d7803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d800098c0 tx=0x7f3d80006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 msgr2=0x7f3d9419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097f0 tx=0x7f3d840327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 shutdown_connections 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f3d78038fc0 0x7f3d7803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 --2- 172.21.15.144:0/2544439684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d94105f00 0x7f3d9419d7c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 >> 172.21.15.144:0/2544439684 conn(0x7f3d94101cd0 msgr2=0x7f3d94194460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.293+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 shutdown_connections 2024-09-05T07:42:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:41:59.294+0000 7f3d99a00640 1 -- 172.21.15.144:0/2544439684 wait complete. 2024-09-05T07:42:00.295 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:00.213+0000 7fa831692040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:42:00.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2544439684' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-05T07:42:00.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-mon[29535]: mgrmap e9: x(active, since 21s) 2024-09-05T07:42:00.878 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:00.588+0000 7fa831692040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:42:00.879 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:00.661+0000 7fa831692040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:42:01.296 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:00.877+0000 7fa831692040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:42:01.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:01 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/689165075' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.759+0000 7fb43d800640 1 Processor -- start 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb43d800640 1 -- start start 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb43d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb43d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb438107e10 con 0x7fb438107440 2024-09-05T07:42:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb437e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb437e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60650/0 (socket says 172.21.15.144:60650) 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.760+0000 7fb437e00640 1 -- 172.21.15.144:0/2475260762 learned_addr learned my addr 172.21.15.144:0/2475260762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.761+0000 7fb437e00640 1 -- 172.21.15.144:0/2475260762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb438108640 con 0x7fb438107440 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.762+0000 7fb437e00640 1 --2- 172.21.15.144:0/2475260762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb428009820 tx=0x7fb42802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e449884fa135d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.762+0000 7fb436a00640 1 -- 172.21.15.144:0/2475260762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428037070 con 0x7fb438107440 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.762+0000 7fb436a00640 1 -- 172.21.15.144:0/2475260762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb428032920 con 0x7fb438107440 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.762+0000 7fb436a00640 1 -- 172.21.15.144:0/2475260762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428030810 con 0x7fb438107440 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 -- 172.21.15.144:0/2475260762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 msgr2=0x7fb438107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 --2- 172.21.15.144:0/2475260762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb428009820 tx=0x7fb42802a270 comp rx=0 tx=0).stop 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 -- 172.21.15.144:0/2475260762 shutdown_connections 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 --2- 172.21.15.144:0/2475260762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb438107840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 -- 172.21.15.144:0/2475260762 >> 172.21.15.144:0/2475260762 conn(0x7fb438102c10 msgr2=0x7fb438105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:01.736 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 -- 172.21.15.144:0/2475260762 shutdown_connections 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.763+0000 7fb43d800640 1 -- 172.21.15.144:0/2475260762 wait complete. 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.764+0000 7fb43d800640 1 Processor -- start 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.764+0000 7fb43d800640 1 -- start start 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb43d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb43d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810b9f0 con 0x7fb438107440 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb437e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb437e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60662/0 (socket says 172.21.15.144:60662) 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb437e00640 1 -- 172.21.15.144:0/689165075 learned_addr learned my addr 172.21.15.144:0/689165075 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.765+0000 7fb437e00640 1 -- 172.21.15.144:0/689165075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43819dc90 con 0x7fb438107440 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb437e00640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4280097f0 tx=0x7fb4280327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428037040 con 0x7fb438107440 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb428030c40 con 0x7fb438107440 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42803a5b0 con 0x7fb438107440 2024-09-05T07:42:01.737 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43819df20 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.766+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4381a0c10 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.767+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43810bb70 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.768+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fb42803a7a0 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.768+0000 7fb434c00640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 0x7fb41c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.768+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb42806c4c0 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.768+0000 7fb437400640 1 -- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 msgr2=0x7fb41c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.768+0000 7fb437400640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 0x7fb41c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.773+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4280371e0 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.969+0000 7fb437400640 1 -- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 msgr2=0x7fb41c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.969+0000 7fb437400640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 0x7fb41c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.998+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb4381a0de0 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:00.998+0000 7fb434c00640 1 -- 172.21.15.144:0/689165075 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb42806be10 con 0x7fb438107440 2024-09-05T07:42:01.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 msgr2=0x7fb41c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 0x7fb41c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 msgr2=0x7fb43819d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4280097f0 tx=0x7fb4280327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 shutdown_connections 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7fb41c039020 0x7fb41c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 --2- 172.21.15.144:0/689165075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438107440 0x7fb43819d750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 >> 172.21.15.144:0/689165075 conn(0x7fb438102c10 msgr2=0x7fb4381037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 shutdown_connections 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:01.001+0000 7fb43d800640 1 -- 172.21.15.144:0/689165075 wait complete. 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for the mgr to restart... 2024-09-05T07:42:01.739 INFO:teuthology.orchestra.run.smithi144.stdout:Waiting for mgr epoch 9... 2024-09-05T07:42:02.252 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:02.002+0000 7fa831692040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:42:02.252 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:02.083+0000 7fa831692040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:42:03.133 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:02.991+0000 7fa831692040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:42:03.532 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.132+0000 7fa831692040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:42:03.532 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.293+0000 7fa831692040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:42:03.532 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.364+0000 7fa831692040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:42:03.532 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.531+0000 7fa831692040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:42:03.821 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.612+0000 7fa831692040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:42:03.821 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.691+0000 7fa831692040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:42:04.189 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.870+0000 7fa831692040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:42:04.189 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:03.946+0000 7fa831692040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:42:04.189 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:04.024+0000 7fa831692040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:42:04.189 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:04.119+0000 7fa831692040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:42:04.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:04.188+0000 7fa831692040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:42:04.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:04.257+0000 7fa831692040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:42:05.571 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:05.151+0000 7fa831692040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:42:05.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: Active manager daemon x restarted 2024-09-05T07:42:05.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: Activating manager daemon x 2024-09-05T07:42:05.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: osdmap e3: 0 total, 0 up, 0 in 2024-09-05T07:42:05.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: mgrmap e10: x(active, starting, since 0.00404101s) 2024-09-05T07:42:05.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: Manager daemon x is now available 2024-09-05T07:42:05.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:06.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T07:42:06.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T07:42:06.472 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-mon[29535]: mgrmap e11: x(active, since 1.00752s) 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:06.470+0000 7fa788200640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:07:42:06] ENGINE Error in HTTPServer.serve 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: Traceback (most recent call last): 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._connections.run(self.expiration_interval) 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._run(expiration_interval) 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T07:42:06.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: s = self.context.wrap_socket( 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: return self.sslsocket_class._create( 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self.do_handshake() 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: self._sslobj.do_handshake() 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T07:42:06.823 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:07.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:07 smithi144 ceph-mon[29535]: [05/Sep/2024:07:42:06] ENGINE Bus STARTING 2024-09-05T07:42:07.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:07 smithi144 ceph-mon[29535]: [05/Sep/2024:07:42:06] ENGINE Serving on http://172.21.15.144:8765 2024-09-05T07:42:07.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout { 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout } 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.242+0000 7f9f88e00640 1 Processor -- start 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.242+0000 7f9f88e00640 1 -- start start 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.243+0000 7f9f88e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.243+0000 7f9f88e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8407c8b0 con 0x7f9f8407de80 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.243+0000 7f9f83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:07.333 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.243+0000 7f9f83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60666/0 (socket says 172.21.15.144:60666) 2024-09-05T07:42:07.339 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.243+0000 7f9f83400640 1 -- 172.21.15.144:0/616495594 learned_addr learned my addr 172.21.15.144:0/616495594 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:07.339 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.244+0000 7f9f83400640 1 -- 172.21.15.144:0/616495594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8407ca30 con 0x7f9f8407de80 2024-09-05T07:42:07.339 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.245+0000 7f9f83400640 1 --2- 172.21.15.144:0/616495594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009820 tx=0x7f9f7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0c6e4844080b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:07.339 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.245+0000 7f9f82000640 1 -- 172.21.15.144:0/616495594 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f74037070 con 0x7f9f8407de80 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.245+0000 7f9f82000640 1 -- 172.21.15.144:0/616495594 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f74032920 con 0x7f9f8407de80 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.245+0000 7f9f82000640 1 -- 172.21.15.144:0/616495594 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f74030810 con 0x7f9f8407de80 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 -- 172.21.15.144:0/616495594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 msgr2=0x7f9f8407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 --2- 172.21.15.144:0/616495594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009820 tx=0x7f9f7402a270 comp rx=0 tx=0).stop 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 -- 172.21.15.144:0/616495594 shutdown_connections 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 --2- 172.21.15.144:0/616495594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8407c2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 -- 172.21.15.144:0/616495594 >> 172.21.15.144:0/616495594 conn(0x7f9f84102c10 msgr2=0x7f9f84105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 -- 172.21.15.144:0/616495594 shutdown_connections 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.246+0000 7f9f88e00640 1 -- 172.21.15.144:0/616495594 wait complete. 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.247+0000 7f9f88e00640 1 Processor -- start 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.247+0000 7f9f88e00640 1 -- start start 2024-09-05T07:42:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f88e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f88e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8410dad0 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60682/0 (socket says 172.21.15.144:60682) 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f83400640 1 -- 172.21.15.144:0/4207751649 learned_addr learned my addr 172.21.15.144:0/4207751649 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.248+0000 7f9f83400640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8419dc20 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f83400640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f740097f0 tx=0x7f9f740327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f74037040 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f74030c40 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8419deb0 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f7403a5d0 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.249+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f841a0ba0 con 0x7f9f8407de80 2024-09-05T07:42:07.341 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.250+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f9f7403b3f0 con 0x7f9f8407de80 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.251+0000 7f9f7be00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.251+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9f6803bb90 con 0x7f9f68038fc0 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.251+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f7406c5b0 con 0x7f9f8407de80 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.251+0000 7f9f82a00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 msgr2=0x7f9f6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.251+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.452+0000 7f9f82a00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 msgr2=0x7f9f6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.452+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.853+0000 7f9f82a00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 msgr2=0x7f9f6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:02.853+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:03.654+0000 7f9f82a00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 msgr2=0x7f9f6803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.144:6800/490246891 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:03.654+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:42:07.342 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:05.155+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f9f7406afa0 con 0x7f9f8407de80 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:05.155+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 msgr2=0x7f9f6803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:05.155+0000 7f9f7be00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.157+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f9f74043850 con 0x7f9f8407de80 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.157+0000 7f9f7be00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 0x7f9f6803ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.157+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9f74031ab0 con 0x7f9f6803ca80 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.158+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 0x7f9f6803ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.159+0000 7f9f82a00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 0x7f9f6803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f70003980 tx=0x7f9f70006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.160+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9f74031ab0 con 0x7f9f6803ca80 2024-09-05T07:42:07.343 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.167+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9f8407c360 con 0x7f9f6803ca80 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f7be00640 1 -- 172.21.15.144:0/4207751649 <== mgr.14150 v2:172.21.15.144:6800/2361768482 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9f8407c360 con 0x7f9f6803ca80 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 msgr2=0x7f9f6803ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 0x7f9f6803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f70003980 tx=0x7f9f70006e10 comp rx=0 tx=0).stop 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 msgr2=0x7f9f8419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f740097f0 tx=0x7f9f740327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 shutdown_connections 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9f6803ca80 0x7f9f6803ee70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:6800/490246891,v1:172.21.15.144:6801/490246891] conn(0x7f9f68038fc0 0x7f9f6803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 --2- 172.21.15.144:0/4207751649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f8407de80 0x7f9f8419d6e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.168+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 >> 172.21.15.144:0/4207751649 conn(0x7f9f84102c10 msgr2=0x7f9f84103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.169+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 shutdown_connections 2024-09-05T07:42:07.344 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:06.169+0000 7f9f88e00640 1 -- 172.21.15.144:0/4207751649 wait complete. 2024-09-05T07:42:07.345 INFO:teuthology.orchestra.run.smithi144.stdout:mgr epoch 9 is available 2024-09-05T07:42:07.345 INFO:teuthology.orchestra.run.smithi144.stdout:Generating a dashboard self-signed certificate... 2024-09-05T07:42:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:08 smithi144 ceph-mon[29535]: [05/Sep/2024:07:42:06] ENGINE Serving on https://172.21.15.144:7150 2024-09-05T07:42:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:08 smithi144 ceph-mon[29535]: [05/Sep/2024:07:42:06] ENGINE Bus STARTED 2024-09-05T07:42:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:08 smithi144 ceph-mon[29535]: [05/Sep/2024:07:42:06] ENGINE Error in HTTPServer.serve 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: Traceback (most recent call last): 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._connections.run(self.expiration_interval) 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._run(expiration_interval) 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: s = self.context.wrap_socket( 2024-09-05T07:42:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: return self.sslsocket_class._create( 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: self.do_handshake() 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: self._sslobj.do_handshake() 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T07:42:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:08 smithi144 ceph-mon[29535]: mgrmap e12: x(active, since 2s) 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.885+0000 7f1d3e000640 1 Processor -- start 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d3e000640 1 -- start start 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d3e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d3e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38108010 con 0x7f1d38107640 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:08.908 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33848/0 (socket says 172.21.15.144:33848) 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.886+0000 7f1d37400640 1 -- 172.21.15.144:0/1065093295 learned_addr learned my addr 172.21.15.144:0/1065093295 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.887+0000 7f1d37400640 1 -- 172.21.15.144:0/1065093295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d381087f0 con 0x7f1d38107640 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.888+0000 7f1d37400640 1 --2- 172.21.15.144:0/1065093295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009820 tx=0x7f1d2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1705cff4211851cc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.888+0000 7f1d36000640 1 -- 172.21.15.144:0/1065093295 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d28037070 con 0x7f1d38107640 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.888+0000 7f1d36000640 1 -- 172.21.15.144:0/1065093295 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d28032920 con 0x7f1d38107640 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.888+0000 7f1d36000640 1 -- 172.21.15.144:0/1065093295 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d28030810 con 0x7f1d38107640 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 -- 172.21.15.144:0/1065093295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 msgr2=0x7f1d38107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:08.909 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 --2- 172.21.15.144:0/1065093295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009820 tx=0x7f1d2802a270 comp rx=0 tx=0).stop 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 -- 172.21.15.144:0/1065093295 shutdown_connections 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 --2- 172.21.15.144:0/1065093295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d38107a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 -- 172.21.15.144:0/1065093295 >> 172.21.15.144:0/1065093295 conn(0x7f1d38102dd0 msgr2=0x7f1d38105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 -- 172.21.15.144:0/1065093295 shutdown_connections 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.889+0000 7f1d3e000640 1 -- 172.21.15.144:0/1065093295 wait complete. 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.890+0000 7f1d3e000640 1 Processor -- start 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.890+0000 7f1d3e000640 1 -- start start 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.890+0000 7f1d3e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.890+0000 7f1d3e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3810bba0 con 0x7f1d38107640 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.891+0000 7f1d37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:08.910 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.891+0000 7f1d37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33852/0 (socket says 172.21.15.144:33852) 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.891+0000 7f1d37400640 1 -- 172.21.15.144:0/29269694 learned_addr learned my addr 172.21.15.144:0/29269694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.891+0000 7f1d37400640 1 -- 172.21.15.144:0/29269694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3819bb60 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.891+0000 7f1d37400640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d280097f0 tx=0x7f1d280327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.892+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d28037040 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.892+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d28030cc0 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.892+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3819bdf0 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.892+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d2803a640 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.892+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3819eae0 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.893+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3810bd20 con 0x7f1d38107640 2024-09-05T07:42:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.894+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f1d2803b3f0 con 0x7f1d38107640 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.894+0000 7f1d2fe00640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 0x7f1d1c03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.894+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d2806c4f0 con 0x7f1d38107640 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.895+0000 7f1d36a00640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 0x7f1d1c03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.895+0000 7f1d36a00640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 0x7f1d1c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d240098c0 tx=0x7f1d24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:07.900+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d28042e10 con 0x7f1d38107640 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.058+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1d28049ca0 con 0x7f1d38107640 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.103+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f1d38104060 con 0x7f1d1c038eb0 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.227+0000 7f1d2fe00640 1 -- 172.21.15.144:0/29269694 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f1d38104060 con 0x7f1d1c038eb0 2024-09-05T07:42:08.912 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 msgr2=0x7f1d1c03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 0x7f1d1c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d240098c0 tx=0x7f1d24006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 msgr2=0x7f1d3819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d280097f0 tx=0x7f1d280327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 shutdown_connections 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1d1c038eb0 0x7f1d1c03b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 --2- 172.21.15.144:0/29269694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38107640 0x7f1d3819b620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 >> 172.21.15.144:0/29269694 conn(0x7f1d38102dd0 msgr2=0x7f1d38103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 shutdown_connections 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:08.231+0000 7f1d3e000640 1 -- 172.21.15.144:0/29269694 wait complete. 2024-09-05T07:42:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:Creating initial admin user... 2024-09-05T07:42:09.445 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:09 smithi144 ceph-mon[29535]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:09.445 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:09.446 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:09.446 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:10.878 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VSem.6.judLR2g8/9BRyOOdib1ZFuf31kp8QF4KWuMMCMGBwx.vqa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725522129, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.444+0000 7ff903400640 1 Processor -- start 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.444+0000 7ff903400640 1 -- start start 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.444+0000 7ff903400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.444+0000 7ff903400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc10a240 con 0x7ff8fc109870 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.445+0000 7ff900a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.445+0000 7ff900a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33860/0 (socket says 172.21.15.144:33860) 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.445+0000 7ff900a00640 1 -- 172.21.15.144:0/3768984645 learned_addr learned my addr 172.21.15.144:0/3768984645 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.445+0000 7ff900a00640 1 -- 172.21.15.144:0/3768984645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc10aa10 con 0x7ff8fc109870 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.447+0000 7ff900a00640 1 --2- 172.21.15.144:0/3768984645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009820 tx=0x7ff8f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d44bd72a917a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:10.879 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.447+0000 7ff8fb400640 1 -- 172.21.15.144:0/3768984645 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f0037070 con 0x7ff8fc109870 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.447+0000 7ff8fb400640 1 -- 172.21.15.144:0/3768984645 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8f0032920 con 0x7ff8fc109870 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.447+0000 7ff8fb400640 1 -- 172.21.15.144:0/3768984645 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f0030810 con 0x7ff8fc109870 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 -- 172.21.15.144:0/3768984645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 msgr2=0x7ff8fc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 --2- 172.21.15.144:0/3768984645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009820 tx=0x7ff8f002a270 comp rx=0 tx=0).stop 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 -- 172.21.15.144:0/3768984645 shutdown_connections 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 --2- 172.21.15.144:0/3768984645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc109c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 -- 172.21.15.144:0/3768984645 >> 172.21.15.144:0/3768984645 conn(0x7ff8fc07cf40 msgr2=0x7ff8fc07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 -- 172.21.15.144:0/3768984645 shutdown_connections 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.448+0000 7ff903400640 1 -- 172.21.15.144:0/3768984645 wait complete. 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.449+0000 7ff903400640 1 Processor -- start 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.449+0000 7ff903400640 1 -- start start 2024-09-05T07:42:10.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff903400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff903400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc10ddc0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff900a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff900a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33868/0 (socket says 172.21.15.144:33868) 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff900a00640 1 -- 172.21.15.144:0/3124338355 learned_addr learned my addr 172.21.15.144:0/3124338355 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.450+0000 7ff900a00640 1 -- 172.21.15.144:0/3124338355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc19dd20 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff900a00640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00097f0 tx=0x7ff8f00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f0037040 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8f0030cc0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc19dfb0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f003a6b0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.451+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1a0ca0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.452+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff8f003baf0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.452+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc109cf0 con 0x7ff8fc109870 2024-09-05T07:42:10.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.453+0000 7ff8f9600640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 0x7ff8e403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.453+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff8f006c650 con 0x7ff8fc109870 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.453+0000 7ff8fbe00640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 0x7ff8e403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.454+0000 7ff8fbe00640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 0x7ff8e403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80098c0 tx=0x7ff8e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.459+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8f00371e0 con 0x7ff8fc109870 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.652+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff8fc19e490 con 0x7ff8e4038fc0 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.880+0000 7ff8f9600640 1 -- 172.21.15.144:0/3124338355 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff8fc19e490 con 0x7ff8e4038fc0 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.882+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 msgr2=0x7ff8e403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.882+0000 7ff903400640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 0x7ff8e403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80098c0 tx=0x7ff8e8006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.882+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 msgr2=0x7ff8fc19d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.882+0000 7ff903400640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00097f0 tx=0x7ff8f00327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 shutdown_connections 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff8e4038fc0 0x7ff8e403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:10.882 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 --2- 172.21.15.144:0/3124338355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8fc109870 0x7ff8fc19d7e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:10.883 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 >> 172.21.15.144:0/3124338355 conn(0x7ff8fc07cf40 msgr2=0x7ff8fc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:10.883 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 shutdown_connections 2024-09-05T07:42:10.883 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:09.883+0000 7ff903400640 1 -- 172.21.15.144:0/3124338355 wait complete. 2024-09-05T07:42:10.883 INFO:teuthology.orchestra.run.smithi144.stdout:Fetching dashboard port number... 2024-09-05T07:42:11.137 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:10 smithi144 ceph-mon[29535]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:11.138 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:12.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:11 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3343891365' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-05T07:42:12.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stdout 8443 2024-09-05T07:42:12.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.360+0000 7f9ba7c00640 1 Processor -- start 2024-09-05T07:42:12.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.360+0000 7f9ba7c00640 1 -- start start 2024-09-05T07:42:12.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.360+0000 7f9ba7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:12.386 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.360+0000 7f9ba7c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba010a240 con 0x7f9ba0109870 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.361+0000 7f9ba5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.361+0000 7f9ba5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33872/0 (socket says 172.21.15.144:33872) 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.361+0000 7f9ba5200640 1 -- 172.21.15.144:0/2380460377 learned_addr learned my addr 172.21.15.144:0/2380460377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.361+0000 7f9ba5200640 1 -- 172.21.15.144:0/2380460377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba010aa30 con 0x7f9ba0109870 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.362+0000 7f9ba5200640 1 --2- 172.21.15.144:0/2380460377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009820 tx=0x7f9b9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7080ceb46f9919 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.362+0000 7f9b9f400640 1 -- 172.21.15.144:0/2380460377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b94037070 con 0x7f9ba0109870 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.362+0000 7f9b9f400640 1 -- 172.21.15.144:0/2380460377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b94032920 con 0x7f9ba0109870 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.362+0000 7f9b9f400640 1 -- 172.21.15.144:0/2380460377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b94030810 con 0x7f9ba0109870 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 -- 172.21.15.144:0/2380460377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 msgr2=0x7f9ba0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/2380460377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009820 tx=0x7f9b9402a270 comp rx=0 tx=0).stop 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 -- 172.21.15.144:0/2380460377 shutdown_connections 2024-09-05T07:42:12.387 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/2380460377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba0109c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 -- 172.21.15.144:0/2380460377 >> 172.21.15.144:0/2380460377 conn(0x7f9ba007cdd0 msgr2=0x7f9ba007d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 -- 172.21.15.144:0/2380460377 shutdown_connections 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.363+0000 7f9ba7c00640 1 -- 172.21.15.144:0/2380460377 wait complete. 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.364+0000 7f9ba7c00640 1 Processor -- start 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.364+0000 7f9ba7c00640 1 -- start start 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba7c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba010dde0 con 0x7f9ba0109870 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33884/0 (socket says 172.21.15.144:33884) 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba5200640 1 -- 172.21.15.144:0/3343891365 learned_addr learned my addr 172.21.15.144:0/3343891365 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba5200640 1 -- 172.21.15.144:0/3343891365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba019dd60 con 0x7f9ba0109870 2024-09-05T07:42:12.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.365+0000 7f9ba5200640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b940097f0 tx=0x7f9b940327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.366+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b94037040 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.366+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b94030cc0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.366+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba019dff0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.366+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9403a6b0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.366+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba01a0ce0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.367+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f9b9403b3f0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.367+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba0109cf0 con 0x7f9ba0109870 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.367+0000 7f9b9d600640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 0x7f9b8803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:12.389 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.367+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9b9406c660 con 0x7f9ba0109870 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.368+0000 7f9b9fe00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 0x7f9b8803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.368+0000 7f9b9fe00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 0x7f9b8803b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098c0 tx=0x7f9b8c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.372+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b9403a850 con 0x7f9ba0109870 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.550+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9ba01a12d0 con 0x7f9ba0109870 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.550+0000 7f9b9d600640 1 -- 172.21.15.144:0/3343891365 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f9b94049cc0 con 0x7f9ba0109870 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 msgr2=0x7f9b8803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 0x7f9b8803b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098c0 tx=0x7f9b8c006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 msgr2=0x7f9ba019d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b940097f0 tx=0x7f9b940327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 shutdown_connections 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9b88039020 0x7f9b8803b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 --2- 172.21.15.144:0/3343891365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ba0109870 0x7f9ba019d820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:12.390 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 >> 172.21.15.144:0/3343891365 conn(0x7f9ba007cdd0 msgr2=0x7f9ba0107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:12.391 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 shutdown_connections 2024-09-05T07:42:12.391 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:11.553+0000 7f9ba7c00640 1 -- 172.21.15.144:0/3343891365 wait complete. 2024-09-05T07:42:12.401 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T07:42:12.401 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout disabled 2024-09-05T07:42:12.414 INFO:teuthology.orchestra.run.smithi144.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T07:42:12.414 INFO:teuthology.orchestra.run.smithi144.stdout:systemctl: stdout inactive 2024-09-05T07:42:12.415 INFO:teuthology.orchestra.run.smithi144.stdout:firewalld.service is not enabled 2024-09-05T07:42:12.415 INFO:teuthology.orchestra.run.smithi144.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout:Ceph Dashboard is now available at: 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: URL: https://smithi144.front.sepia.ceph.com:8443/ 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: User: admin 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: Password: w55erb577r 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:12.417 INFO:teuthology.orchestra.run.smithi144.stdout:Saving cluster configuration to /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config directory 2024-09-05T07:42:13.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:12 smithi144 ceph-mon[29535]: mgrmap e13: x(active, since 6s) 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff22800640 1 Processor -- start 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff22800640 1 -- start start 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff22800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff22800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c108050 con 0x7eff1c107680 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58744/0 (socket says 172.21.15.144:58744) 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.913+0000 7eff1b400640 1 -- 172.21.15.144:0/1539129655 learned_addr learned my addr 172.21.15.144:0/1539129655 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.914+0000 7eff1b400640 1 -- 172.21.15.144:0/1539129655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c108830 con 0x7eff1c107680 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.915+0000 7eff1b400640 1 --2- 172.21.15.144:0/1539129655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009820 tx=0x7eff0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdcc6f06fa2ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:13.784 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.915+0000 7eff1aa00640 1 -- 172.21.15.144:0/1539129655 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c037070 con 0x7eff1c107680 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.915+0000 7eff1aa00640 1 -- 172.21.15.144:0/1539129655 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0c032920 con 0x7eff1c107680 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.915+0000 7eff1aa00640 1 -- 172.21.15.144:0/1539129655 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c030810 con 0x7eff1c107680 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 -- 172.21.15.144:0/1539129655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 msgr2=0x7eff1c107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 --2- 172.21.15.144:0/1539129655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009820 tx=0x7eff0c02a270 comp rx=0 tx=0).stop 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 -- 172.21.15.144:0/1539129655 shutdown_connections 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 --2- 172.21.15.144:0/1539129655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c107a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 -- 172.21.15.144:0/1539129655 >> 172.21.15.144:0/1539129655 conn(0x7eff1c102e50 msgr2=0x7eff1c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 -- 172.21.15.144:0/1539129655 shutdown_connections 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.916+0000 7eff22800640 1 -- 172.21.15.144:0/1539129655 wait complete. 2024-09-05T07:42:13.785 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.917+0000 7eff22800640 1 Processor -- start 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.917+0000 7eff22800640 1 -- start start 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.917+0000 7eff22800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.917+0000 7eff22800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c10bbe0 con 0x7eff1c107680 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58750/0 (socket says 172.21.15.144:58750) 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff1b400640 1 -- 172.21.15.144:0/2813530250 learned_addr learned my addr 172.21.15.144:0/2813530250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff1b400640 1 -- 172.21.15.144:0/2813530250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c19bbf0 con 0x7eff1c107680 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff1b400640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097f0 tx=0x7eff0c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c037040 con 0x7eff1c107680 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.918+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0c030c40 con 0x7eff1c107680 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.919+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c19be80 con 0x7eff1c107680 2024-09-05T07:42:13.786 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.919+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c03a5b0 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.919+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c19eb70 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.920+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7eff0c03b3f0 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.920+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c10bd60 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.920+0000 7eff18c00640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 0x7eff0003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.920+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff0c06c650 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.920+0000 7eff13e00640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 0x7eff0003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.921+0000 7eff13e00640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 0x7eff0003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff040098c0 tx=0x7eff04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:12.925+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff0c042de0 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.193+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7eff1c19ed40 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.196+0000 7eff18c00640 1 -- 172.21.15.144:0/2813530250 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7eff0c03ab20 con 0x7eff1c107680 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 msgr2=0x7eff0003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:13.787 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 0x7eff0003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff040098c0 tx=0x7eff04006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 msgr2=0x7eff1c19b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097f0 tx=0x7eff0c0327b0 comp rx=0 tx=0).stop 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 shutdown_connections 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff000390c0 0x7eff0003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 --2- 172.21.15.144:0/2813530250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c107680 0x7eff1c19b6b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 >> 172.21.15.144:0/2813530250 conn(0x7eff1c102e50 msgr2=0x7eff1c103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 shutdown_connections 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/ceph: stderr 2024-09-05T07:42:13.198+0000 7eff22800640 1 -- 172.21.15.144:0/2813530250 wait complete. 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.788 INFO:teuthology.orchestra.run.smithi144.stdout:Or, if you are only running a single cluster on this host: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: ceph telemetry on 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout:For more information see: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:13.789 INFO:teuthology.orchestra.run.smithi144.stdout:Bootstrap complete. 2024-09-05T07:42:13.841 INFO:tasks.cephadm:Fetching config... 2024-09-05T07:42:13.841 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:13.841 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-05T07:42:13.878 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-05T07:42:13.878 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:13.878 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-05T07:42:13.955 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-05T07:42:13.955 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:13.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-05T07:42:14.051 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-05T07:42:14.051 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:14.051 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-05T07:42:14.126 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-05T07:42:14.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T07:42:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:14.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T07:42:14.310 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:14 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2813530250' entity='client.admin' 2024-09-05T07:42:14.313 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:14.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T07:42:14.367 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDOhdPLKnOusKoQKyVG882WMjP/hlxFNnf8/182KSeRJOtX0Wfhe5sx007O9AwNrTcpq/h1OfUXbf+Ma480A4wBvp84mtKN3+hD8FwNfIcp85ZLaP6p3fchUZL31mTOkiPCpR6mlrSE8chZgwboInVCq1bLH9RFBY/PMDM4bLrDOnQoZcmwFHZvJqw2z56uk8WZsutdtuM5Opq8yPV+2Y0eED4TT0FRVgzIcv1bjGXuLGeoLnsHF28XFMRrdAMiUWCR1AENTtmPSwRc+ZQWC4OYfC0hLTTyyxCIvdfBdSu7FM6xodmPpFK1D+OGv6Mnh3RuTYATpMDjnpN2P93jaTmiHsqu/1XHDv4wAl3xNZPXmdfEFZi8Dw1mpHUS8dNiRlPy3tzfGfS2YGSE7aTjz6kaCuxM/h5yKdASwuCcr5zRIM+n7GQO8ZdxRZS0bvgcwRx8j78rZplhCAruMk5aPtEisIe5wrgyz6JVrmaxSnXzLt3K/pUbLpjrDDHzmKH5EM= ceph-17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:14.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-05T07:42:14.747 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 -- 172.21.15.144:0/2618036766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 msgr2=0x7fa2d8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 --2- 172.21.15.144:0/2618036766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8074600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009880 tx=0x7fa2cc02a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 -- 172.21.15.144:0/2618036766 shutdown_connections 2024-09-05T07:42:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 --2- 172.21.15.144:0/2618036766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8074600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 -- 172.21.15.144:0/2618036766 >> 172.21.15.144:0/2618036766 conn(0x7fa2d80fcdf0 msgr2=0x7fa2d80ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 -- 172.21.15.144:0/2618036766 shutdown_connections 2024-09-05T07:42:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.296+0000 7fa2df600640 1 -- 172.21.15.144:0/2618036766 wait complete. 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.297+0000 7fa2df600640 1 Processor -- start 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.297+0000 7fa2df600640 1 -- start start 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2df600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2df600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8109920 con 0x7fa2d80761a0 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2dcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2dcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58754/0 (socket says 172.21.15.144:58754) 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2dcc00640 1 -- 172.21.15.144:0/2576497716 learned_addr learned my addr 172.21.15.144:0/2576497716 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.298+0000 7fa2dcc00640 1 -- 172.21.15.144:0/2576497716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d8199480 con 0x7fa2d80761a0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2dcc00640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc004f60 tx=0x7fa2cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2cc03f070 con 0x7fa2d80761a0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2cc003ad0 con 0x7fa2d80761a0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d8199710 con 0x7fa2d80761a0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2cc035030 con 0x7fa2d80761a0 2024-09-05T07:42:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.299+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d819c400 con 0x7fa2d80761a0 2024-09-05T07:42:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.301+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fa2cc042070 con 0x7fa2d80761a0 2024-09-05T07:42:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.300+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d810a0a0 con 0x7fa2d80761a0 2024-09-05T07:42:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.301+0000 7fa2d5600640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 0x7fa2c003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.301+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa2cc06ced0 con 0x7fa2d80761a0 2024-09-05T07:42:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.301+0000 7fa2d7e00640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 0x7fa2c003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.302+0000 7fa2d7e00640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 0x7fa2c003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098c0 tx=0x7fa2c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.306+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2cc03a3c0 con 0x7fa2d80761a0 2024-09-05T07:42:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.491+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa2d802d830 con 0x7fa2d80761a0 2024-09-05T07:42:15.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.494+0000 7fa2d5600640 1 -- 172.21.15.144:0/2576497716 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fa2cc030d90 con 0x7fa2d80761a0 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 msgr2=0x7fa2c003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 0x7fa2c003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098c0 tx=0x7fa2c4006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 msgr2=0x7fa2d8198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc004f60 tx=0x7fa2cc0048f0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 shutdown_connections 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2c00390c0 0x7fa2c003b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 --2- 172.21.15.144:0/2576497716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d80761a0 0x7fa2d8198f40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 >> 172.21.15.144:0/2576497716 conn(0x7fa2d80fcdf0 msgr2=0x7fa2d80fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 shutdown_connections 2024-09-05T07:42:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:15.497+0000 7fa2df600640 1 -- 172.21.15.144:0/2576497716 wait complete. 2024-09-05T07:42:16.132 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-05T07:42:16.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-05T07:42:16.688 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:16 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2576497716' entity='client.admin' 2024-09-05T07:42:17.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.448+0000 7f2def400640 1 -- 172.21.15.144:0/1528913470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 msgr2=0x7f2de8101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:17.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.448+0000 7f2def400640 1 --2- 172.21.15.144:0/1528913470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8101a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009880 tx=0x7f2dd802a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.449+0000 7f2def400640 1 -- 172.21.15.144:0/1528913470 shutdown_connections 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.449+0000 7f2def400640 1 --2- 172.21.15.144:0/1528913470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8101a20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.449+0000 7f2def400640 1 -- 172.21.15.144:0/1528913470 >> 172.21.15.144:0/1528913470 conn(0x7f2de80fcdf0 msgr2=0x7f2de80ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.449+0000 7f2def400640 1 -- 172.21.15.144:0/1528913470 shutdown_connections 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.449+0000 7f2def400640 1 -- 172.21.15.144:0/1528913470 wait complete. 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2def400640 1 Processor -- start 2024-09-05T07:42:17.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2def400640 1 -- start start 2024-09-05T07:42:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2def400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2def400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8107730 con 0x7f2de8101620 2024-09-05T07:42:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2deca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2deca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58774/0 (socket says 172.21.15.144:58774) 2024-09-05T07:42:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.450+0000 7f2deca00640 1 -- 172.21.15.144:0/3332085132 learned_addr learned my addr 172.21.15.144:0/3332085132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2deca00640 1 -- 172.21.15.144:0/3332085132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de81994c0 con 0x7f2de8101620 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2deca00640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8004f60 tx=0x7f2dd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd803f070 con 0x7f2de8101620 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd8004cc0 con 0x7f2de8101620 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd8035030 con 0x7f2de8101620 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.451+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de8199750 con 0x7f2de8101620 2024-09-05T07:42:17.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.452+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de819c440 con 0x7f2de8101620 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.453+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2dd8042070 con 0x7f2de8101620 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.453+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8107eb0 con 0x7f2de8101620 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.453+0000 7f2de5600640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 0x7f2dcc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.453+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2dd806cd10 con 0x7f2de8101620 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.453+0000 7f2de7e00640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 0x7f2dcc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.454+0000 7f2de7e00640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 0x7f2dcc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40098c0 tx=0x7f2dd4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:17.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.458+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dd8040260 con 0x7f2de8101620 2024-09-05T07:42:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.644+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f2de802d830 con 0x7f2dcc0390c0 2024-09-05T07:42:17.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.648+0000 7f2de5600640 1 -- 172.21.15.144:0/3332085132 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2de802d830 con 0x7f2dcc0390c0 2024-09-05T07:42:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 msgr2=0x7f2dcc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 0x7f2dcc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40098c0 tx=0x7f2dd4006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 msgr2=0x7f2de8198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8004f60 tx=0x7f2dd80048f0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.652 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:17.652 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:17.652 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:42:17.653 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:17.653 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:17.653 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:17.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 shutdown_connections 2024-09-05T07:42:17.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2dcc0390c0 0x7f2dcc03b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 --2- 172.21.15.144:0/3332085132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de8101620 0x7f2de8198f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 >> 172.21.15.144:0/3332085132 conn(0x7f2de80fcdf0 msgr2=0x7f2de80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 shutdown_connections 2024-09-05T07:42:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:17.651+0000 7f2def400640 1 -- 172.21.15.144:0/3332085132 wait complete. 2024-09-05T07:42:18.426 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-05T07:42:18.426 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:42:18.426 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-05T07:42:18.447 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:42:18.447 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:18.505 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-05T07:42:18.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch host add smithi154 2024-09-05T07:42:18.941 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:18.941 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:18.942 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:18.942 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:18.942 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:42:18.942 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-05T07:42:18.942 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:18 smithi144 ceph-mon[29535]: Updating smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:19.350 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:19.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:19 smithi144 ceph-mon[29535]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:19.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:19 smithi144 ceph-mon[29535]: Updating smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T07:42:19.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:19.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:19.816 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:19.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 -- 172.21.15.144:0/3282616317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 msgr2=0x7fc144109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 --2- 172.21.15.144:0/3282616317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc144109a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc134009880 tx=0x7fc13402a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 -- 172.21.15.144:0/3282616317 shutdown_connections 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 --2- 172.21.15.144:0/3282616317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc144109a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 -- 172.21.15.144:0/3282616317 >> 172.21.15.144:0/3282616317 conn(0x7fc1440ff260 msgr2=0x7fc144101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.925+0000 7fc148a00640 1 -- 172.21.15.144:0/3282616317 shutdown_connections 2024-09-05T07:42:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.926+0000 7fc148a00640 1 -- 172.21.15.144:0/3282616317 wait complete. 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.926+0000 7fc148a00640 1 Processor -- start 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc148a00640 1 -- start start 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc148a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc148a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc14410dca0 con 0x7fc144109670 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc142800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc142800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58788/0 (socket says 172.21.15.144:58788) 2024-09-05T07:42:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.927+0000 7fc142800640 1 -- 172.21.15.144:0/630082677 learned_addr learned my addr 172.21.15.144:0/630082677 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc142800640 1 -- 172.21.15.144:0/630082677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1441996e0 con 0x7fc144109670 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc142800640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc134009230 tx=0x7fc134003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc13403f070 con 0x7fc144109670 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc13403bd40 con 0x7fc144109670 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc144199970 con 0x7fc144109670 2024-09-05T07:42:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc134035030 con 0x7fc144109670 2024-09-05T07:42:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.928+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc144199dd0 con 0x7fc144109670 2024-09-05T07:42:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.929+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc134042070 con 0x7fc144109670 2024-09-05T07:42:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.929+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc144104ce0 con 0x7fc144109670 2024-09-05T07:42:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.930+0000 7fc13b400640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 0x7fc12803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.930+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc13406cc10 con 0x7fc144109670 2024-09-05T07:42:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.930+0000 7fc141e00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 0x7fc12803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.931+0000 7fc141e00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 0x7fc12803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:19.935+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1340412c0 con 0x7fc144109670 2024-09-05T07:42:20.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:20.113+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) -- 0x7fc14419a560 con 0x7fc1280390c0 2024-09-05T07:42:21.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:20 smithi144 ceph-mon[29535]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:22.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:21 smithi144 ceph-mon[29535]: Deploying cephadm binary to smithi154 2024-09-05T07:42:23.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.292+0000 7fc13b400640 1 -- 172.21.15.144:0/630082677 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc14419a560 con 0x7fc1280390c0 2024-09-05T07:42:23.294 INFO:teuthology.orchestra.run.smithi144.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 msgr2=0x7fc12803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 0x7fc12803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 msgr2=0x7fc1441991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc134009230 tx=0x7fc134003d80 comp rx=0 tx=0).stop 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 shutdown_connections 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1280390c0 0x7fc12803b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 --2- 172.21.15.144:0/630082677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc144109670 0x7fc1441991a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 >> 172.21.15.144:0/630082677 conn(0x7fc1440ff260 msgr2=0x7fc144100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 shutdown_connections 2024-09-05T07:42:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:23.295+0000 7fc148a00640 1 -- 172.21.15.144:0/630082677 wait complete. 2024-09-05T07:42:23.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T07:42:24.350 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:24.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:24 smithi144 ceph-mon[29535]: Added host smithi154 2024-09-05T07:42:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 -- 172.21.15.144:0/265170793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 msgr2=0x7f038c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 --2- 172.21.15.144:0/265170793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c074970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f037c009880 tx=0x7f037c02a670 comp rx=0 tx=0).stop 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 -- 172.21.15.144:0/265170793 shutdown_connections 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 --2- 172.21.15.144:0/265170793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c074970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 -- 172.21.15.144:0/265170793 >> 172.21.15.144:0/265170793 conn(0x7f038c0fd2b0 msgr2=0x7f038c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 -- 172.21.15.144:0/265170793 shutdown_connections 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.968+0000 7f0391c00640 1 -- 172.21.15.144:0/265170793 wait complete. 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.969+0000 7f0391c00640 1 Processor -- start 2024-09-05T07:42:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.969+0000 7f0391c00640 1 -- start start 2024-09-05T07:42:24.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f0391c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f0391c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1122f0 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f038aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f038aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47376/0 (socket says 172.21.15.144:47376) 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f038aa00640 1 -- 172.21.15.144:0/1462499849 learned_addr learned my addr 172.21.15.144:0/1462499849 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.970+0000 7f038aa00640 1 -- 172.21.15.144:0/1462499849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c1a3920 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f038aa00640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f037c009230 tx=0x7f037c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c03f070 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f037c03bd40 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c1a3bb0 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c035030 con 0x7f038c074590 2024-09-05T07:42:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.971+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c19d5a0 con 0x7f038c074590 2024-09-05T07:42:24.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.972+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c075cd0 con 0x7f038c074590 2024-09-05T07:42:24.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.972+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f037c042070 con 0x7f038c074590 2024-09-05T07:42:24.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.973+0000 7f0383400640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 0x7f037003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.973+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f037c06cd20 con 0x7f038c074590 2024-09-05T07:42:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.973+0000 7f038a000640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 0x7f037003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.974+0000 7f038a000640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 0x7f037003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03780098c0 tx=0x7f0378006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:24.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:24.978+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f037c030d60 con 0x7f038c074590 2024-09-05T07:42:25.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.156+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f038c19ead0 con 0x7f0370039060 2024-09-05T07:42:25.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.158+0000 7f0383400640 1 -- 172.21.15.144:0/1462499849 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f038c19ead0 con 0x7f0370039060 2024-09-05T07:42:25.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:25.159 INFO:teuthology.orchestra.run.smithi144.stdout:[{"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 msgr2=0x7f037003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 0x7f037003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03780098c0 tx=0x7f0378006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 msgr2=0x7f038c1a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f037c009230 tx=0x7f037c003d80 comp rx=0 tx=0).stop 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 shutdown_connections 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0370039060 0x7f037003b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 --2- 172.21.15.144:0/1462499849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c074590 0x7f038c1a33e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.160+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 >> 172.21.15.144:0/1462499849 conn(0x7f038c0fd2b0 msgr2=0x7f038c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.161+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 shutdown_connections 2024-09-05T07:42:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:25.161+0000 7f0391c00640 1 -- 172.21.15.144:0/1462499849 wait complete. 2024-09-05T07:42:25.784 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:25.784 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:25 smithi144 ceph-mon[29535]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:42:25.784 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:25 smithi144 ceph-mon[29535]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:25.822 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-09-05T07:42:25.822 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:42:25.822 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-09-05T07:42:25.841 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:42:25.841 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:25.900 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-09-05T07:42:25.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch host add smithi175 2024-09-05T07:42:26.258 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 -- 172.21.15.144:0/1768568943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 msgr2=0x7f3598074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 --2- 172.21.15.144:0/1768568943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f3598074970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3588009880 tx=0x7f358802a670 comp rx=0 tx=0).stop 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 -- 172.21.15.144:0/1768568943 shutdown_connections 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 --2- 172.21.15.144:0/1768568943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f3598074970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 -- 172.21.15.144:0/1768568943 >> 172.21.15.144:0/1768568943 conn(0x7f35980fd0a0 msgr2=0x7f35980ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 -- 172.21.15.144:0/1768568943 shutdown_connections 2024-09-05T07:42:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.790+0000 7f359d600640 1 -- 172.21.15.144:0/1768568943 wait complete. 2024-09-05T07:42:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.791+0000 7f359d600640 1 Processor -- start 2024-09-05T07:42:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.791+0000 7f359d600640 1 -- start start 2024-09-05T07:42:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.791+0000 7f359d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.791+0000 7f359d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35981120c0 con 0x7f3598074590 2024-09-05T07:42:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.791+0000 7f3597e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3597e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47394/0 (socket says 172.21.15.144:47394) 2024-09-05T07:42:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3597e00640 1 -- 172.21.15.144:0/904455361 learned_addr learned my addr 172.21.15.144:0/904455361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3597e00640 1 -- 172.21.15.144:0/904455361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359819db10 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3597e00640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3588009230 tx=0x7f3588003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358803f070 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358803bd40 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3588035030 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.792+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359819dda0 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.793+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359819e200 con 0x7f3598074590 2024-09-05T07:42:26.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.794+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f3588042070 con 0x7f3598074590 2024-09-05T07:42:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.794+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598075cd0 con 0x7f3598074590 2024-09-05T07:42:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.794+0000 7f3595600640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 0x7f357c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.794+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f358806cc80 con 0x7f3598074590 2024-09-05T07:42:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.794+0000 7f358fe00640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 0x7f357c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.795+0000 7f358fe00640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 0x7f357c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35800098c0 tx=0x7f3580006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.799+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f358803ac70 con 0x7f3598074590 2024-09-05T07:42:26.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:26.977+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) -- 0x7f359819e9a0 con 0x7f357c039060 2024-09-05T07:42:28.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:42:29.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: Updating smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: Deploying cephadm binary to smithi175 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: Updating smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.400+0000 7f3595600640 1 -- 172.21.15.144:0/904455361 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f359819e9a0 con 0x7f357c039060 2024-09-05T07:42:30.402 INFO:teuthology.orchestra.run.smithi144.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-09-05T07:42:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 msgr2=0x7f357c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 0x7f357c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35800098c0 tx=0x7f3580006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 msgr2=0x7f359819d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3588009230 tx=0x7f3588003d80 comp rx=0 tx=0).stop 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 shutdown_connections 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f357c039060 0x7f357c03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 --2- 172.21.15.144:0/904455361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3598074590 0x7f359819d5d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.403+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 >> 172.21.15.144:0/904455361 conn(0x7f35980fd0a0 msgr2=0x7f35980fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.404+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 shutdown_connections 2024-09-05T07:42:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:30.404+0000 7f359d600640 1 -- 172.21.15.144:0/904455361 wait complete. 2024-09-05T07:42:30.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:30 smithi144 ceph-mon[29535]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:31.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T07:42:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:31.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:31.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:31 smithi144 ceph-mon[29535]: Added host smithi175 2024-09-05T07:42:31.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:31.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:31.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 -- 172.21.15.144:0/4178077881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 msgr2=0x7f1234109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 --2- 172.21.15.144:0/4178077881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234109a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1228009c20 tx=0x7f122802aa90 comp rx=0 tx=0).stop 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 -- 172.21.15.144:0/4178077881 shutdown_connections 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 --2- 172.21.15.144:0/4178077881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234109a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 -- 172.21.15.144:0/4178077881 >> 172.21.15.144:0/4178077881 conn(0x7f12340ff260 msgr2=0x7f1234101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 -- 172.21.15.144:0/4178077881 shutdown_connections 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.959+0000 7f123ae00640 1 -- 172.21.15.144:0/4178077881 wait complete. 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.960+0000 7f123ae00640 1 Processor -- start 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.960+0000 7f123ae00640 1 -- start start 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f123ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f123ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f123410dc60 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f1239a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f1239a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47410/0 (socket says 172.21.15.144:47410) 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f1239a00640 1 -- 172.21.15.144:0/195683018 learned_addr learned my addr 172.21.15.144:0/195683018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.961+0000 7f1239a00640 1 -- 172.21.15.144:0/195683018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1234199690 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f1239a00640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1228009d40 tx=0x7f122802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1228047070 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1228003e40 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1234199920 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1228033050 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.962+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1234199d80 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.963+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f122804a070 con 0x7f1234109650 2024-09-05T07:42:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.963+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234104d00 con 0x7f1234109650 2024-09-05T07:42:31.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.963+0000 7f1232000640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 0x7f121c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:31.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.963+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f122803e030 con 0x7f1234109650 2024-09-05T07:42:31.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.964+0000 7f1239000640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 0x7f121c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:31.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.964+0000 7f1239000640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 0x7f121c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12200098c0 tx=0x7f1220006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:31.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:31.969+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1228048260 con 0x7f1234109650 2024-09-05T07:42:32.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.154+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f123419a510 con 0x7f121c039060 2024-09-05T07:42:32.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.155+0000 7f1232000640 1 -- 172.21.15.144:0/195683018 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f123419a510 con 0x7f121c039060 2024-09-05T07:42:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:42:32.156 INFO:teuthology.orchestra.run.smithi144.stdout:[{"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-09-05T07:42:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 msgr2=0x7f121c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 0x7f121c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12200098c0 tx=0x7f1220006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 msgr2=0x7f1234199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1228009d40 tx=0x7f122802fc10 comp rx=0 tx=0).stop 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 shutdown_connections 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f121c039060 0x7f121c03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 --2- 172.21.15.144:0/195683018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234109650 0x7f1234199150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 >> 172.21.15.144:0/195683018 conn(0x7f12340ff260 msgr2=0x7f1234100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 shutdown_connections 2024-09-05T07:42:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:32.157+0000 7f123ae00640 1 -- 172.21.15.144:0/195683018 wait complete. 2024-09-05T07:42:32.704 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:32 smithi144 ceph-mon[29535]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:32.704 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:32.850 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-05T07:42:32.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd crush tunables default 2024-09-05T07:42:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:33.667 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:33 smithi144 ceph-mon[29535]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:42:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.778+0000 7fb64f200640 1 -- 172.21.15.144:0/3804140929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 msgr2=0x7fb648074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.778+0000 7fb64f200640 1 --2- 172.21.15.144:0/3804140929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb648074970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb638009880 tx=0x7fb63802a670 comp rx=0 tx=0).stop 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.779+0000 7fb64f200640 1 -- 172.21.15.144:0/3804140929 shutdown_connections 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.779+0000 7fb64f200640 1 --2- 172.21.15.144:0/3804140929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb648074970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.779+0000 7fb64f200640 1 -- 172.21.15.144:0/3804140929 >> 172.21.15.144:0/3804140929 conn(0x7fb6480fd2b0 msgr2=0x7fb6480ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.779+0000 7fb64f200640 1 -- 172.21.15.144:0/3804140929 shutdown_connections 2024-09-05T07:42:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.779+0000 7fb64f200640 1 -- 172.21.15.144:0/3804140929 wait complete. 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb64f200640 1 Processor -- start 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb64f200640 1 -- start start 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb64f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb64f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481122f0 con 0x7fb648074590 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb647e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb647e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53256/0 (socket says 172.21.15.144:53256) 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.780+0000 7fb647e00640 1 -- 172.21.15.144:0/2716769017 learned_addr learned my addr 172.21.15.144:0/2716769017 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb647e00640 1 -- 172.21.15.144:0/2716769017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6481a3920 con 0x7fb648074590 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb647e00640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb638009230 tx=0x7fb638003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63803f070 con 0x7fb648074590 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb63803bd40 con 0x7fb648074590 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481a3bb0 con 0x7fb648074590 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb638035030 con 0x7fb648074590 2024-09-05T07:42:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.781+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64819d5a0 con 0x7fb648074590 2024-09-05T07:42:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.783+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb638042070 con 0x7fb648074590 2024-09-05T07:42:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.783+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb648075cd0 con 0x7fb648074590 2024-09-05T07:42:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.783+0000 7fb644c00640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 0x7fb62c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.783+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb63806cc60 con 0x7fb648074590 2024-09-05T07:42:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.783+0000 7fb647400640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 0x7fb62c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.784+0000 7fb647400640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 0x7fb62c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098c0 tx=0x7fb634006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.788+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb638030d60 con 0x7fb648074590 2024-09-05T07:42:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:33.967+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb6480749f0 con 0x7fb648074590 2024-09-05T07:42:34.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.409+0000 7fb644c00640 1 -- 172.21.15.144:0/2716769017 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fb63803b860 con 0x7fb648074590 2024-09-05T07:42:34.410 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 msgr2=0x7fb62c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 0x7fb62c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098c0 tx=0x7fb634006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 msgr2=0x7fb6481a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb638009230 tx=0x7fb638003d80 comp rx=0 tx=0).stop 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 shutdown_connections 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb62c039060 0x7fb62c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 --2- 172.21.15.144:0/2716769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb648074590 0x7fb6481a33e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 >> 172.21.15.144:0/2716769017 conn(0x7fb6480fd2b0 msgr2=0x7fb6480fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 shutdown_connections 2024-09-05T07:42:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:34.412+0000 7fb64f200640 1 -- 172.21.15.144:0/2716769017 wait complete. 2024-09-05T07:42:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2716769017' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:34.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:42:35.168 INFO:tasks.cephadm:Adding mon.a on smithi144 2024-09-05T07:42:35.168 INFO:tasks.cephadm:Adding mon.b on smithi154 2024-09-05T07:42:35.168 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-09-05T07:42:35.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch apply mon '3;smithi144:172.21.15.144=a;smithi154:172.21.15.154=b;smithi175:172.21.15.175=c' 2024-09-05T07:42:35.401 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:35.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-05T07:42:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2716769017' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-05T07:42:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:35.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 -- 172.21.15.175:0/102155601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 msgr2=0x7f26a81079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:35.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 --2- 172.21.15.175:0/102155601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a81079a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f269c009880 tx=0x7f269c02a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:35.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 -- 172.21.15.175:0/102155601 shutdown_connections 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 --2- 172.21.15.175:0/102155601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a81079a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 -- 172.21.15.175:0/102155601 >> 172.21.15.175:0/102155601 conn(0x7f26a80fb920 msgr2=0x7f26a80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 -- 172.21.15.175:0/102155601 shutdown_connections 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.931+0000 7f26aeccb640 1 -- 172.21.15.175:0/102155601 wait complete. 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aeccb640 1 Processor -- start 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aeccb640 1 -- start start 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aeccb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aeccb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26a810bc00 con 0x7f26a81075c0 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aca67640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:35.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aca67640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.175:60764/0 (socket says 172.21.15.175:60764) 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aca67640 1 -- 172.21.15.175:0/825880447 learned_addr learned my addr 172.21.15.175:0/825880447 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.932+0000 7f26aca67640 1 -- 172.21.15.175:0/825880447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a8102ba0 con 0x7f26a81075c0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26aca67640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f269c009230 tx=0x7f269c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c03f070 con 0x7f26a81075c0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a8101250 con 0x7f26a81075c0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c03bc80 con 0x7f26a81075c0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c035030 con 0x7f26a81075c0 2024-09-05T07:42:35.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.933+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a8101710 con 0x7f26a81075c0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.934+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f269c042070 con 0x7f26a81075c0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.934+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a8107a20 con 0x7f26a81075c0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.934+0000 7f26a5ffb640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 0x7f269803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.934+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f269c06cef0 con 0x7f26a81075c0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.935+0000 7f26a7fff640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 0x7f269803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.935+0000 7f26a7fff640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 0x7f269803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26940098c0 tx=0x7f2694006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:35.939+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f269c04c350 con 0x7f26a81075c0 2024-09-05T07:42:36.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.117+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi144:172.21.15.144=a;smithi154:172.21.15.154=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}) -- 0x7f26a8000990 con 0x7f2698039060 2024-09-05T07:42:36.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.123+0000 7f26a5ffb640 1 -- 172.21.15.175:0/825880447 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f26a8000990 con 0x7f2698039060 2024-09-05T07:42:36.123 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-09-05T07:42:36.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 msgr2=0x7f269803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:36.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 0x7f269803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26940098c0 tx=0x7f2694006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:36.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 msgr2=0x7f26a8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:36.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f269c009230 tx=0x7f269c003d40 comp rx=0 tx=0).stop 2024-09-05T07:42:36.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 shutdown_connections 2024-09-05T07:42:36.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2698039060 0x7f269803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:36.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 --2- 172.21.15.175:0/825880447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26a81075c0 0x7f26a8100cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:36.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 >> 172.21.15.175:0/825880447 conn(0x7f26a80fb920 msgr2=0x7f26a80fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:36.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 shutdown_connections 2024-09-05T07:42:36.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:36.125+0000 7f26aeccb640 1 -- 172.21.15.175:0/825880447 wait complete. 2024-09-05T07:42:36.717 DEBUG:teuthology.orchestra.run.smithi154:mon.b> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.b.service 2024-09-05T07:42:36.720 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.c.service 2024-09-05T07:42:36.722 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T07:42:36.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T07:42:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: Updating smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: Updating smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:36.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:37.400 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:37.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 -- 172.21.15.175:0/898511108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 msgr2=0x7f2ab4100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:37.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/898511108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4100d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009880 tx=0x7f2aa402a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:37.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 -- 172.21.15.175:0/898511108 shutdown_connections 2024-09-05T07:42:37.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/898511108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4100d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:37.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 -- 172.21.15.175:0/898511108 >> 172.21.15.175:0/898511108 conn(0x7f2ab4076250 msgr2=0x7f2ab4076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:37.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 -- 172.21.15.175:0/898511108 shutdown_connections 2024-09-05T07:42:37.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.798+0000 7f2ab96c7640 1 -- 172.21.15.175:0/898511108 wait complete. 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.799+0000 7f2ab96c7640 1 Processor -- start 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.799+0000 7f2ab96c7640 1 -- start start 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.799+0000 7f2ab96c7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.799+0000 7f2ab96c7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab410ab90 con 0x7f2ab4100990 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.800+0000 7f2ab2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.800+0000 7f2ab2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.175:60780/0 (socket says 172.21.15.175:60780) 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.800+0000 7f2ab2ffd640 1 -- 172.21.15.175:0/978626334 learned_addr learned my addr 172.21.15.175:0/978626334 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.800+0000 7f2ab2ffd640 1 -- 172.21.15.175:0/978626334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab4196670 con 0x7f2ab4100990 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab2ffd640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009230 tx=0x7f2aa4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa4046070 con 0x7f2ab4100990 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab4196900 con 0x7f2ab4100990 2024-09-05T07:42:37.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aa4038c90 con 0x7f2ab4100990 2024-09-05T07:42:37.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab419aa00 con 0x7f2ab4100990 2024-09-05T07:42:37.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.801+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa4035070 con 0x7f2ab4100990 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.802+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2aa4049070 con 0x7f2ab4100990 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.802+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab4101c40 con 0x7f2ab4100990 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.802+0000 7f2ab0ff9640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 0x7f2aa003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.802+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2aa403e070 con 0x7f2ab4100990 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.802+0000 7f2aabfff640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 0x7f2aa003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:37.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.803+0000 7f2aabfff640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 0x7f2aa003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0098c0 tx=0x7f2a9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:37.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:37.807+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2aa404a3b0 con 0x7f2ab4100990 2024-09-05T07:42:37.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:37 smithi144 ceph-mon[29535]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi144:172.21.15.144=a;smithi154:172.21.15.154=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:42:37.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:37 smithi144 ceph-mon[29535]: Saving service mon spec with placement smithi144:172.21.15.144=a;smithi154:172.21.15.154=b;smithi175:172.21.15.175=c;count:3 2024-09-05T07:42:37.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:37 smithi144 ceph-mon[29535]: Deploying daemon mon.c on smithi175 2024-09-05T07:42:38.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.040+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2ab4100df0 con 0x7f2ab4100990 2024-09-05T07:42:38.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.040+0000 7f2ab0ff9640 1 -- 172.21.15.175:0/978626334 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f2aa403ed60 con 0x7f2ab4100990 2024-09-05T07:42:38.041 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:42:38.041 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","modified":"2024-09-05T07:41:08.934859Z","created":"2024-09-05T07:41:08.934859Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T07:42:38.041 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-05T07:42:38.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 msgr2=0x7f2aa003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:38.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 0x7f2aa003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0098c0 tx=0x7f2a9c006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:38.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 msgr2=0x7f2ab4196130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009230 tx=0x7f2aa4003d80 comp rx=0 tx=0).stop 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 shutdown_connections 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2aa0039060 0x7f2aa003b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 --2- 172.21.15.175:0/978626334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ab4100990 0x7f2ab4196130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 >> 172.21.15.175:0/978626334 conn(0x7f2ab4076250 msgr2=0x7f2ab41020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 shutdown_connections 2024-09-05T07:42:38.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:38.043+0000 7f2ab96c7640 1 -- 172.21.15.175:0/978626334 wait complete. 2024-09-05T07:42:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:38 smithi144 ceph-mon[29535]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:38 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/978626334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:39.618 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T07:42:39.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T07:42:39.960 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:42:40.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 -- 172.21.15.175:0/762075668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 msgr2=0x7f87f0106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 --2- 172.21.15.175:0/762075668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009c20 tx=0x7f87e802aa90 comp rx=0 tx=0).stop 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 -- 172.21.15.175:0/762075668 shutdown_connections 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 --2- 172.21.15.175:0/762075668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 -- 172.21.15.175:0/762075668 >> 172.21.15.175:0/762075668 conn(0x7f87f00fc280 msgr2=0x7f87f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 -- 172.21.15.175:0/762075668 shutdown_connections 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.394+0000 7f87f64d6640 1 -- 172.21.15.175:0/762075668 wait complete. 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.395+0000 7f87f64d6640 1 Processor -- start 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.395+0000 7f87f64d6640 1 -- start start 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.395+0000 7f87f64d6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:40.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.395+0000 7f87f64d6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010ac80 con 0x7f87f0106650 2024-09-05T07:42:40.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.396+0000 7f87effff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.396+0000 7f87effff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.175:60794/0 (socket says 172.21.15.175:60794) 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.396+0000 7f87effff640 1 -- 172.21.15.175:0/1837574432 learned_addr learned my addr 172.21.15.175:0/1837574432 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.396+0000 7f87effff640 1 -- 172.21.15.175:0/1837574432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f0199980 con 0x7f87f0106650 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87effff640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005e30 tx=0x7f87e802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e8047070 con 0x7f87f0106650 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f0199c10 con 0x7f87f0106650 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8003df0 con 0x7f87f0106650 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e8033050 con 0x7f87f0106650 2024-09-05T07:42:40.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.397+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f019dd10 con 0x7f87f0106650 2024-09-05T07:42:40.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.398+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f87e804a070 con 0x7f87f0106650 2024-09-05T07:42:40.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.398+0000 7f87ed7fa640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 0x7f87d803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:40.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.398+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f87e803e030 con 0x7f87f0106650 2024-09-05T07:42:40.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.398+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0101cc0 con 0x7f87f0106650 2024-09-05T07:42:40.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.399+0000 7f87ef7fe640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 0x7f87d803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:40.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.399+0000 7f87ef7fe640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 0x7f87d803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87e40098c0 tx=0x7f87e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:40.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.404+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87e8051020 con 0x7f87f0106650 2024-09-05T07:42:40.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.692+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f87f0106ae0 con 0x7f87f0106650 2024-09-05T07:42:40.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.692+0000 7f87ed7fa640 1 -- 172.21.15.175:0/1837574432 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f87f0106ae0 con 0x7f87f0106650 2024-09-05T07:42:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:42:40.693 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","modified":"2024-09-05T07:41:08.934859Z","created":"2024-09-05T07:41:08.934859Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T07:42:40.694 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-05T07:42:40.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 msgr2=0x7f87d803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:40.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 0x7f87d803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87e40098c0 tx=0x7f87e4006db0 comp rx=0 tx=0).stop 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 msgr2=0x7f87f0199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005e30 tx=0x7f87e802fc10 comp rx=0 tx=0).stop 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 shutdown_connections 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f87d8039060 0x7f87d803b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 --2- 172.21.15.175:0/1837574432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f0106650 0x7f87f0199440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 >> 172.21.15.175:0/1837574432 conn(0x7f87f00fc280 msgr2=0x7f87f00fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 shutdown_connections 2024-09-05T07:42:40.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:40.695+0000 7f87f64d6640 1 -- 172.21.15.175:0/1837574432 wait complete. 2024-09-05T07:42:40.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:40 smithi144 ceph-mon[29535]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:41.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/1837574432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:41.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:41 smithi175 systemd[1]: Started Ceph mon.c for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:42:42.287 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T07:42:42.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T07:42:42.535 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: mon.a calling monitor election 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: mon.c calling monitor election 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: monmap epoch 2 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: last_changed 2024-09-05T07:42:41.618530+0000 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: min_mon_release 19 (squid) 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: election_strategy: 1 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:46.943 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: fsmap 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: mgrmap e13: x(active, since 41s) 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: overall HEALTH_OK 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:46.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:47.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:47.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: mon.a calling monitor election 2024-09-05T07:42:47.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: mon.c calling monitor election 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: monmap epoch 2 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: last_changed 2024-09-05T07:42:41.618530+0000 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:47.073 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: min_mon_release 19 (squid) 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: election_strategy: 1 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: fsmap 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: mgrmap e13: x(active, since 41s) 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: overall HEALTH_OK 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:47.074 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:47.075 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:47.075 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:47.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 -- 172.21.15.175:0/3771603757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac04003530 msgr2=0x7fac040059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:47.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 --2- 172.21.15.175:0/3771603757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac04003530 0x7fac040059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac181016c0 tx=0x7fac0802bfe0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 -- 172.21.15.175:0/3771603757 shutdown_connections 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 --2- 172.21.15.175:0/3771603757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac04003530 0x7fac040059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 -- 172.21.15.175:0/3771603757 >> 172.21.15.175:0/3771603757 conn(0x7fac180fc280 msgr2=0x7fac180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 -- 172.21.15.175:0/3771603757 shutdown_connections 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.381+0000 7fac1d23f640 1 -- 172.21.15.175:0/3771603757 wait complete. 2024-09-05T07:42:47.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.382+0000 7fac1d23f640 1 Processor -- start 2024-09-05T07:42:47.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.382+0000 7fac1d23f640 1 -- start start 2024-09-05T07:42:47.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1d23f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:47.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1d23f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 0x7fac18198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1d23f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac18108690 con 0x7fac181985d0 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1d23f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac18108510 con 0x7fac04003530 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58880/0 (socket says 172.21.15.175:58880) 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 -- 172.21.15.175:0/2219735662 learned_addr learned my addr 172.21.15.175:0/2219735662 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 -- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 msgr2=0x7fac18198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 -- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 msgr2=0x7fac18198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac16d9d640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1659c640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 0x7fac18198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1659c640 1 -- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 msgr2=0x7fac18198090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1659c640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.383+0000 7fac1659c640 1 -- 172.21.15.175:0/2219735662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac181a1100 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac1659c640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 0x7fac18198a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fac0000b3d0 tx=0x7fac0000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fac00011630 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac00011cb0 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac181a12d0 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fac00010df0 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.384+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac181a1860 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.385+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac18101cc0 con 0x7fac181985d0 2024-09-05T07:42:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.385+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fac00018020 con 0x7fac181985d0 2024-09-05T07:42:47.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.385+0000 7fac0ffff640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 0x7fabf803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:47.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.385+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac0004beb0 con 0x7fac181985d0 2024-09-05T07:42:47.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.386+0000 7fac16d9d640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 0x7fabf803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:47.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.386+0000 7fac16d9d640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 0x7fabf803b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac08009b30 tx=0x7fac08005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:47.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.391+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac0001f020 con 0x7fac181985d0 2024-09-05T07:42:47.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.623+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fac181097c0 con 0x7fac181985d0 2024-09-05T07:42:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.624+0000 7fac0ffff640 1 -- 172.21.15.175:0/2219735662 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fac00018310 con 0x7fac181985d0 2024-09-05T07:42:47.624 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:42:47.624 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","modified":"2024-09-05T07:42:41.618530Z","created":"2024-09-05T07:41:08.934859Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T07:42:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-05T07:42:47.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 msgr2=0x7fabf803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 0x7fabf803b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac08009b30 tx=0x7fac08005c50 comp rx=0 tx=0).stop 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 msgr2=0x7fac18198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 0x7fac18198a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fac0000b3d0 tx=0x7fac0000b890 comp rx=0 tx=0).stop 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 shutdown_connections 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fabf8038e00 0x7fabf803b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac181985d0 0x7fac18198a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 --2- 172.21.15.175:0/2219735662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04003530 0x7fac18198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:47.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 >> 172.21.15.175:0/2219735662 conn(0x7fac180fc280 msgr2=0x7fac180fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:47.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 shutdown_connections 2024-09-05T07:42:47.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:47.626+0000 7fac1d23f640 1 -- 172.21.15.175:0/2219735662 wait complete. 2024-09-05T07:42:47.915 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:47 smithi175 ceph-mon[34585]: Deploying daemon mon.b on smithi154 2024-09-05T07:42:47.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:47 smithi175 ceph-mon[34585]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:47.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:47 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:47.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:47 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2219735662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:48.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:47 smithi144 ceph-mon[29535]: Deploying daemon mon.b on smithi154 2024-09-05T07:42:48.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:47 smithi144 ceph-mon[29535]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:48.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:47 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:48.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:47 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2219735662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:49.076 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:48.618+0000 7fa7cf600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-05T07:42:49.202 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T07:42:49.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T07:42:49.456 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:42:49.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 -- 172.21.15.175:0/4241258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 msgr2=0x7f28b8107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:49.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 --2- 172.21.15.175:0/4241258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8107aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009880 tx=0x7f28ac02a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:49.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 -- 172.21.15.175:0/4241258389 shutdown_connections 2024-09-05T07:42:49.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 --2- 172.21.15.175:0/4241258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8107aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 -- 172.21.15.175:0/4241258389 >> 172.21.15.175:0/4241258389 conn(0x7f28b80fd3e0 msgr2=0x7f28b80ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 -- 172.21.15.175:0/4241258389 shutdown_connections 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.884+0000 7f28bf85f640 1 -- 172.21.15.175:0/4241258389 wait complete. 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 Processor -- start 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 -- start start 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28b810bd80 con 0x7f28b81076c0 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bf85f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28b810bc00 con 0x7f28b8197980 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58882/0 (socket says 172.21.15.175:58882) 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 -- 172.21.15.175:0/2574087159 learned_addr learned my addr 172.21.15.175:0/2574087159 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:49.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bd5fb640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 -- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 msgr2=0x7f28b819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 -- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 msgr2=0x7f28b819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.885+0000 7f28bcdfa640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bd5fb640 1 -- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 msgr2=0x7f28b819bd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bd5fb640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bd5fb640 1 -- 172.21.15.175:0/2574087159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b8197fa0 con 0x7f28b81076c0 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bd5fb640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8197440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005ab0 tx=0x7f28ac032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f28ac035070 con 0x7f28b81076c0 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b819c250 con 0x7f28b81076c0 2024-09-05T07:42:49.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28ac032e40 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f28ac03bc10 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.886+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b819c790 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.887+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f28ac042030 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.887+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b8102e00 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.887+0000 7f28aa7fc640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 0x7f28a403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.887+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f28ac040070 con 0x7f28b81076c0 2024-09-05T07:42:49.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.888+0000 7f28bcdfa640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 0x7f28a403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:49.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.888+0000 7f28bcdfa640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 0x7f28a403b310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009100 tx=0x7f28b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:49.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:49.893+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28ac03bdb0 con 0x7f28b81076c0 2024-09-05T07:42:50.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.120+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f28b819ca40 con 0x7f28b81076c0 2024-09-05T07:42:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.121+0000 7f28aa7fc640 1 -- 172.21.15.175:0/2574087159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f28ac03b460 con 0x7f28b81076c0 2024-09-05T07:42:50.122 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:42:50.122 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","modified":"2024-09-05T07:42:41.618530Z","created":"2024-09-05T07:41:08.934859Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T07:42:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-05T07:42:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.123+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 msgr2=0x7f28a403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.123+0000 7f28bf85f640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 0x7f28a403b310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009100 tx=0x7f28b4008040 comp rx=0 tx=0).stop 2024-09-05T07:42:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 msgr2=0x7f28b8197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8197440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005ab0 tx=0x7f28ac032c50 comp rx=0 tx=0).stop 2024-09-05T07:42:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 shutdown_connections 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f28a4038e50 0x7f28a403b310 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28b8197980 0x7f28b819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 --2- 172.21.15.175:0/2574087159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b81076c0 0x7f28b8197440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 >> 172.21.15.175:0/2574087159 conn(0x7f28b80fd3e0 msgr2=0x7f28b80fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 shutdown_connections 2024-09-05T07:42:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:50.124+0000 7f28bf85f640 1 -- 172.21.15.175:0/2574087159 wait complete. 2024-09-05T07:42:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:50 smithi144 ceph-mon[29535]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:50 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2574087159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:50.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:50 smithi175 ceph-mon[34585]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:50.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:50 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2574087159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:50 smithi154 systemd[1]: Started Ceph mon.b for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:42:51.744 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T07:42:51.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T07:42:51.993 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.607+0000 7fc0dffa5640 1 -- 172.21.15.175:0/189297432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c4003530 msgr2=0x7fc0c40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.607+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/189297432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c4003530 0x7fc0c40059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0d81016c0 tx=0x7fc0d402c150 comp rx=0 tx=0).stop 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.607+0000 7fc0dffa5640 1 -- 172.21.15.175:0/189297432 shutdown_connections 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.607+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/189297432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c4003530 0x7fc0c40059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.607+0000 7fc0dffa5640 1 -- 172.21.15.175:0/189297432 >> 172.21.15.175:0/189297432 conn(0x7fc0d80fc280 msgr2=0x7fc0d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.608+0000 7fc0dffa5640 1 -- 172.21.15.175:0/189297432 shutdown_connections 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.608+0000 7fc0dffa5640 1 -- 172.21.15.175:0/189297432 wait complete. 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.608+0000 7fc0dffa5640 1 Processor -- start 2024-09-05T07:42:55.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 -- start start 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 0x7fc0d819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8108690 con 0x7fc0d819c150 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8108510 con 0x7fc0c4003530 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dffa5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8108810 con 0x7fc0d8197880 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dd540640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:55.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0ddd41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dd540640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51166/0 (socket says 172.21.15.175:51166) 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dd540640 1 -- 172.21.15.175:0/938700839 learned_addr learned my addr 172.21.15.175:0/938700839 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dd540640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 msgr2=0x7fc0d819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.609+0000 7fc0dd540640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 msgr2=0x7fc0d819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0dd540640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0ddd41640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 msgr2=0x7fc0d8197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 0x7fc0d819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0ddd41640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 msgr2=0x7fc0d8197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0ddd41640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0ddd41640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0dd540640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 msgr2=0x7fc0d819bc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:55.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 msgr2=0x7fc0d8197340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 -- 172.21.15.175:0/938700839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d81a3ec0 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.610+0000 7fc0de542640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 0x7fc0d819c600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000bd50 tx=0x7fc0d000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.611+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0019070 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.611+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0d0014920 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.611+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d81a40f0 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.611+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0012990 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.611+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d81a4600 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.612+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc0d001c070 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.612+0000 7fc0ceffd640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 0x7fc0bc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.612+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d81097c0 con 0x7fc0d819c150 2024-09-05T07:42:55.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.612+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc0d004be50 con 0x7fc0d819c150 2024-09-05T07:42:55.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.612+0000 7fc0ddd41640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 0x7fc0bc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:55.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.613+0000 7fc0ddd41640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 0x7fc0bc03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005fd0 tx=0x7fc0d4005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:55.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.617+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0d000e0a0 con 0x7fc0d819c150 2024-09-05T07:42:55.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: mon.c calling monitor election 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: mon.a calling monitor election 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: monmap epoch 3 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: min_mon_release 19 (squid) 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: election_strategy: 1 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: fsmap 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: mgrmap e13: x(active, since 50s) 2024-09-05T07:42:55.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: overall HEALTH_OK 2024-09-05T07:42:55.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: mon.c calling monitor election 2024-09-05T07:42:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: mon.a calling monitor election 2024-09-05T07:42:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: monmap epoch 3 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: min_mon_release 19 (squid) 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: election_strategy: 1 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: fsmap 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: mgrmap e13: x(active, since 50s) 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: overall HEALTH_OK 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.862+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc0d81a4920 con 0x7fc0d819c150 2024-09-05T07:42:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.863+0000 7fc0ceffd640 1 -- 172.21.15.175:0/938700839 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7fc0d0013ba0 con 0x7fc0d819c150 2024-09-05T07:42:55.863 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:42:55.863 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","modified":"2024-09-05T07:42:50.484001Z","created":"2024-09-05T07:41:08.934859Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T07:42:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 msgr2=0x7fc0bc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 0x7fc0bc03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005fd0 tx=0x7fc0d4005d10 comp rx=0 tx=0).stop 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 msgr2=0x7fc0d819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 0x7fc0d819c600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000bd50 tx=0x7fc0d000be40 comp rx=0 tx=0).stop 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 shutdown_connections 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc0bc0394f0 0x7fc0bc03b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0d819c150 0x7fc0d819c600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d8197880 0x7fc0d819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 --2- 172.21.15.175:0/938700839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0c4003530 0x7fc0d8197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 >> 172.21.15.175:0/938700839 conn(0x7fc0d80fc280 msgr2=0x7fc0d806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 shutdown_connections 2024-09-05T07:42:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:55.865+0000 7fc0dffa5640 1 -- 172.21.15.175:0/938700839 wait complete. 2024-09-05T07:42:56.450 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-05T07:42:56.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph config generate-minimal-conf 2024-09-05T07:42:56.765 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:56 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:56.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:56 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/938700839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:56.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:56 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:56.806 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:56 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:56.806 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:56 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/938700839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:56.806 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:56 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:56.837 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:42:57.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.406+0000 7f1be2a00640 1 -- 172.21.15.144:0/2404407083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 msgr2=0x7f1bdc107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:57.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.406+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2404407083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc107840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009880 tx=0x7f1bd002a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.407+0000 7f1be2a00640 1 -- 172.21.15.144:0/2404407083 shutdown_connections 2024-09-05T07:42:57.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.407+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2404407083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc107840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.407+0000 7f1be2a00640 1 -- 172.21.15.144:0/2404407083 >> 172.21.15.144:0/2404407083 conn(0x7f1bdc0fd0b0 msgr2=0x7f1bdc0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.407+0000 7f1be2a00640 1 -- 172.21.15.144:0/2404407083 shutdown_connections 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.407+0000 7f1be2a00640 1 -- 172.21.15.144:0/2404407083 wait complete. 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.408+0000 7f1be2a00640 1 Processor -- start 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.408+0000 7f1be2a00640 1 -- start start 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bdc1a3420 0x7f1bdc1a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc10ba90 con 0x7f1bdc107460 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc10b910 con 0x7f1bdc074a30 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc10bc10 con 0x7f1bdc1a3420 2024-09-05T07:42:57.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50046/0 (socket says 172.21.15.144:50046) 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be1600640 1 -- 172.21.15.144:0/2275818332 learned_addr learned my addr 172.21.15.144:0/2275818332 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be0c00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.409+0000 7f1be2000640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bdc1a3420 0x7f1bdc1a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be0c00640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 msgr2=0x7f1bdc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be0c00640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 msgr2=0x7f1bdc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be0c00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be0c00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bdc1a3420 msgr2=0x7f1bdc1a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bdc1a3420 0x7f1bdc1a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 msgr2=0x7f1bdc074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 -- 172.21.15.144:0/2275818332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc1a5e50 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be1600640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006010 tx=0x7f1bd0003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd003f070 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd003b460 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bdc1a6140 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.410+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0035030 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.411+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bdc1a66d0 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.412+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bdc1078c0 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.412+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f1bd0042070 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.412+0000 7f1bda000640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 0x7f1bc403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.412+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1bd006cbc0 con 0x7f1bdc107460 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.413+0000 7f1be0c00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 0x7f1bc403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.413+0000 7f1be0c00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 0x7f1bc403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8006fd0 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:57.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.418+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bd0039750 con 0x7f1bdc107460 2024-09-05T07:42:57.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.626+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f1bdc1a6930 con 0x7f1bdc107460 2024-09-05T07:42:57.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.626+0000 7f1bda000640 1 -- 172.21.15.144:0/2275818332 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f1bd0042c80 con 0x7f1bdc107460 2024-09-05T07:42:57.627 INFO:teuthology.orchestra.run.smithi144.stdout:# minimal ceph.conf for 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:57.627 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-05T07:42:57.627 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:57.627 INFO:teuthology.orchestra.run.smithi144.stdout: mon_host = [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-09-05T07:42:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.628+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 msgr2=0x7f1bc403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.628+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 0x7f1bc403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8006fd0 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2024-09-05T07:42:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.628+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 msgr2=0x7f1bdc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.628+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006010 tx=0x7f1bd0003c00 comp rx=0 tx=0).stop 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 shutdown_connections 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1bc40394f0 0x7f1bc403b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bdc074a30 0x7f1bdc074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bdc1a3420 0x7f1bdc1a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 --2- 172.21.15.144:0/2275818332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bdc107460 0x7f1bdc0744f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 >> 172.21.15.144:0/2275818332 conn(0x7f1bdc0fd0b0 msgr2=0x7f1bdc0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 shutdown_connections 2024-09-05T07:42:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:42:57.629+0000 7f1be2a00640 1 -- 172.21.15.144:0/2275818332 wait complete. 2024-09-05T07:42:57.846 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: mon.c calling monitor election 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: mon.a calling monitor election 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:42:57.847 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: monmap epoch 3 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: min_mon_release 19 (squid) 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: election_strategy: 1 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: fsmap 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:57.848 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: mgrmap e13: x(active, since 50s) 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: overall HEALTH_OK 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/938700839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T07:42:57.849 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mon.b calling monitor election 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mon.b calling monitor election 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mon.c calling monitor election 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mon.a calling monitor election 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: monmap epoch 3 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:58.271 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: min_mon_release 19 (squid) 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: election_strategy: 1 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: fsmap 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: mgrmap e13: x(active, since 52s) 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: overall HEALTH_OK 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2275818332' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.272 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.273 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.273 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.312 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-05T07:42:58.313 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:58.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T07:42:58.371 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:42:58.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:58.468 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:42:58.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mon.b calling monitor election 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mon.b calling monitor election 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mon.c calling monitor election 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mon.a calling monitor election 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T07:42:58.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: monmap epoch 3 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: min_mon_release 19 (squid) 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: election_strategy: 1 2024-09-05T07:42:58.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: fsmap 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: mgrmap e13: x(active, since 52s) 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: overall HEALTH_OK 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2275818332' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.497 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.498 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:42:58.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:58.564 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:42:58.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T07:42:58.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mon.b calling monitor election 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mon.b calling monitor election 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mon.c calling monitor election 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mon.a calling monitor election 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: monmap epoch 3 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: last_changed 2024-09-05T07:42:50.484001+0000 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: created 2024-09-05T07:41:08.934859+0000 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: min_mon_release 19 (squid) 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: election_strategy: 1 2024-09-05T07:42:58.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: 0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: fsmap 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: mgrmap e13: x(active, since 52s) 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: overall HEALTH_OK 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2275818332' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.590 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.590 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:58.594 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:42:58.594 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T07:42:58.660 INFO:tasks.cephadm:Adding mgr.x on smithi144 2024-09-05T07:42:58.660 INFO:tasks.cephadm:Adding mgr.y on smithi154 2024-09-05T07:42:58.660 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-09-05T07:42:58.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch apply mgr '3;smithi144=x;smithi154=y;smithi175=z' 2024-09-05T07:42:58.932 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:42:59.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: Updating smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: Updating smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: Updating smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: Reconfiguring daemon mon.a on smithi144 2024-09-05T07:42:59.339 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:42:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 -- 172.21.15.175:0/3500815079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38601005e0 msgr2=0x7f38601009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 --2- 172.21.15.175:0/3500815079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38601005e0 0x7f38601009e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3850009880 tx=0x7f385002a5d0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 -- 172.21.15.175:0/3500815079 shutdown_connections 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 --2- 172.21.15.175:0/3500815079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38601005e0 0x7f38601009e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 -- 172.21.15.175:0/3500815079 >> 172.21.15.175:0/3500815079 conn(0x7f38600fbdb0 msgr2=0x7f38600fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 -- 172.21.15.175:0/3500815079 shutdown_connections 2024-09-05T07:42:59.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.352+0000 7f38666f7640 1 -- 172.21.15.175:0/3500815079 wait complete. 2024-09-05T07:42:59.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 Processor -- start 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 -- start start 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 0x7f386006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f386019c650 0x7f386019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38601066d0 con 0x7f386019c650 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3860106550 con 0x7f38601005e0 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f38666f7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3860106850 con 0x7f3860199d20 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f3857fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f3857fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51168/0 (socket says 172.21.15.175:51168) 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.353+0000 7f3857fff640 1 -- 172.21.15.175:0/3009413063 learned_addr learned my addr 172.21.15.175:0/3009413063 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:42:59.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f385ffff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 0x7f386006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 -- 172.21.15.175:0/3009413063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 msgr2=0x7f386006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 0x7f386006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 -- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f386019c650 msgr2=0x7f386019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f386019c650 0x7f386019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 -- 172.21.15.175:0/3009413063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386019f420 con 0x7f3860199d20 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f385ffff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 0x7f386006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f3857fff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f384800b520 tx=0x7f384800b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848004230 con 0x7f3860199d20 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386019f6b0 con 0x7f3860199d20 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38480043d0 con 0x7f3860199d20 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848003d60 con 0x7f3860199d20 2024-09-05T07:42:59.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.354+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386019fc70 con 0x7f3860199d20 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.355+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f384800e070 con 0x7f3860199d20 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.355+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386018f490 con 0x7f3860199d20 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.355+0000 7f385dffb640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 0x7f384c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.355+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f384804ba70 con 0x7f3860199d20 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.356+0000 7f385ffff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 0x7f384c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:42:59.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.356+0000 7f385ffff640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 0x7f384c03b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3850031440 tx=0x7f38500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:42:59.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.360+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3848014020 con 0x7f3860199d20 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: Updating smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: Updating smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: Updating smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T07:42:59.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:59.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:42:59.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:59.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: Reconfiguring daemon mon.a on smithi144 2024-09-05T07:42:59.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:59.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.538+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi144=x;smithi154=y;smithi175=z", "target": ["mon-mgr", ""]}) -- 0x7f38600626c0 con 0x7f384c0394f0 2024-09-05T07:42:59.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.544+0000 7f385dffb640 1 -- 172.21.15.175:0/3009413063 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f38600626c0 con 0x7f384c0394f0 2024-09-05T07:42:59.545 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 msgr2=0x7f384c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 0x7f384c03b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3850031440 tx=0x7f38500058d0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 msgr2=0x7f386019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f384800b520 tx=0x7f384800b9e0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 shutdown_connections 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f384c0394f0 0x7f384c03b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f386019c650 0x7f386019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860199d20 0x7f386019c110 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 --2- 172.21.15.175:0/3009413063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38601005e0 0x7f386006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 >> 172.21.15.175:0/3009413063 conn(0x7f38600fbdb0 msgr2=0x7f38600fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:42:59.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 shutdown_connections 2024-09-05T07:42:59.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:42:59.546+0000 7f38666f7640 1 -- 172.21.15.175:0/3009413063 wait complete. 2024-09-05T07:42:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: Updating smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: Updating smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: Updating smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:42:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:42:59.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: Reconfiguring daemon mon.a on smithi144 2024-09-05T07:42:59.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:42:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:42:59.821 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:42:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:42:59.484+0000 7fa7cf600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-05T07:43:00.143 DEBUG:teuthology.orchestra.run.smithi154:mgr.y> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.y.service 2024-09-05T07:43:00.145 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.z.service 2024-09-05T07:43:00.148 INFO:tasks.cephadm:Deploying OSDs... 2024-09-05T07:43:00.148 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:43:00.148 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T07:43:00.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T07:43:00.184 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-05T07:43:00.260 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T07:43:00.260 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:00.260 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-05T07:43:00.260 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:00.261 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:00.261 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-05 07:42:18.265508413 +0000 2024-09-05T07:43:00.261 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-05 07:38:04.036055263 +0000 2024-09-05T07:43:00.261 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-05 07:38:04.036055263 +0000 2024-09-05T07:43:00.261 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-05 07:38:04.036055263 +0000 2024-09-05T07:43:00.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T07:43:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-05T07:43:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-05T07:43:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000364792 s, 1.4 MB/s 2024-09-05T07:43:00.360 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T07:43:00.398 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-05T07:43:00.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:00.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:00.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:00.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:00.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-05 07:42:18.314507583 +0000 2024-09-05T07:43:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-05 07:38:04.548046490 +0000 2024-09-05T07:43:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-05 07:38:04.548046490 +0000 2024-09-05T07:43:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-05 07:38:04.548046490 +0000 2024-09-05T07:43:00.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T07:43:00.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-05T07:43:00.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-05T07:43:00.569 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00029699 s, 1.7 MB/s 2024-09-05T07:43:00.570 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.608 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-05T07:43:00.685 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T07:43:00.685 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-05 07:42:18.363506754 +0000 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-05 07:38:05.029038248 +0000 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-05 07:38:05.029038248 +0000 2024-09-05T07:43:00.686 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-05 07:38:05.029038248 +0000 2024-09-05T07:43:00.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T07:43:00.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-05T07:43:00.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-05T07:43:00.782 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000269316 s, 1.9 MB/s 2024-09-05T07:43:00.785 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T07:43:00.822 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-05T07:43:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:00.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:00.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:00.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:00.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-05 07:42:18.413505908 +0000 2024-09-05T07:43:00.899 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-05 07:38:05.550029321 +0000 2024-09-05T07:43:00.900 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-05 07:38:05.550029321 +0000 2024-09-05T07:43:00.900 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-05 07:38:05.550029321 +0000 2024-09-05T07:43:00.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T07:43:00.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-05T07:43:00.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-05T07:43:00.992 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000274218 s, 1.9 MB/s 2024-09-05T07:43:00.995 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T07:43:01.030 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-05T07:43:01.031 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T07:43:01.050 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T07:43:01.050 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-05T07:43:01.109 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-05 07:42:49.909134614 +0000 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-05 07:37:35.008725572 +0000 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-05 07:37:35.008725572 +0000 2024-09-05T07:43:01.110 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-05 07:37:35.008725572 +0000 2024-09-05T07:43:01.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T07:43:01.177 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-05T07:43:01.177 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-05T07:43:01.177 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000237083 s, 2.2 MB/s 2024-09-05T07:43:01.178 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T07:43:01.238 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-05 07:42:49.909134614 +0000 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-05 07:37:35.350716114 +0000 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-05 07:37:35.350716114 +0000 2024-09-05T07:43:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-05 07:37:35.350716114 +0000 2024-09-05T07:43:01.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T07:43:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-05T07:43:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-05T07:43:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000195599 s, 2.6 MB/s 2024-09-05T07:43:01.363 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T07:43:01.420 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-05T07:43:01.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:01 smithi154 ceph-mon[34710]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi144=x;smithi154=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:01.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:01 smithi154 ceph-mon[34710]: Saving service mgr spec with placement smithi144=x;smithi154=y;smithi175=z;count:3 2024-09-05T07:43:01.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:01 smithi154 ceph-mon[34710]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T07:43:01.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:01 smithi154 ceph-mon[34710]: Reconfiguring daemon mgr.x on smithi144 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-05 07:42:49.909134614 +0000 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-05 07:37:35.674707153 +0000 2024-09-05T07:43:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-05 07:37:35.674707153 +0000 2024-09-05T07:43:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-05 07:37:35.674707153 +0000 2024-09-05T07:43:01.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T07:43:01.518 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-05T07:43:01.519 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-05T07:43:01.519 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000213419 s, 2.4 MB/s 2024-09-05T07:43:01.520 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T07:43:01.577 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-05 07:42:49.910134587 +0000 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-05 07:37:36.000698137 +0000 2024-09-05T07:43:01.634 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-05 07:37:36.000698137 +0000 2024-09-05T07:43:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-05 07:37:36.000698137 +0000 2024-09-05T07:43:01.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T07:43:01.698 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-05T07:43:01.699 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-05T07:43:01.699 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000260163 s, 2.0 MB/s 2024-09-05T07:43:01.700 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T07:43:01.756 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-05T07:43:01.757 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T07:43:01.776 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T07:43:01.777 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-05T07:43:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:01 smithi144 ceph-mon[29535]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi144=x;smithi154=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:01 smithi144 ceph-mon[29535]: Saving service mgr spec with placement smithi144=x;smithi154=y;smithi175=z;count:3 2024-09-05T07:43:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:01 smithi144 ceph-mon[29535]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T07:43:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:01 smithi144 ceph-mon[29535]: Reconfiguring daemon mgr.x on smithi144 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-05 07:42:40.556326350 +0000 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-05 07:37:35.009805929 +0000 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-05 07:37:35.009805929 +0000 2024-09-05T07:43:01.836 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-05 07:37:35.009805929 +0000 2024-09-05T07:43:01.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T07:43:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:01 smithi175 ceph-mon[34585]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi144=x;smithi154=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:01 smithi175 ceph-mon[34585]: Saving service mgr spec with placement smithi144=x;smithi154=y;smithi175=z;count:3 2024-09-05T07:43:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:01 smithi175 ceph-mon[34585]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T07:43:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:01 smithi175 ceph-mon[34585]: Reconfiguring daemon mgr.x on smithi144 2024-09-05T07:43:01.864 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-05T07:43:01.864 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-05T07:43:01.864 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000233642 s, 2.2 MB/s 2024-09-05T07:43:01.866 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T07:43:01.925 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-05T07:43:01.982 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T07:43:01.982 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-05 07:42:40.556326350 +0000 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-05 07:37:35.347801046 +0000 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-05 07:37:35.347801046 +0000 2024-09-05T07:43:01.983 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-05 07:37:35.347801046 +0000 2024-09-05T07:43:01.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T07:43:02.049 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-05T07:43:02.049 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-05T07:43:02.049 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000205111 s, 2.5 MB/s 2024-09-05T07:43:02.050 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T07:43:02.109 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-05 07:42:40.557326335 +0000 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-05 07:37:35.676796292 +0000 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-05 07:37:35.676796292 +0000 2024-09-05T07:43:02.168 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-05 07:37:35.676796292 +0000 2024-09-05T07:43:02.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T07:43:02.234 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-05T07:43:02.234 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-05T07:43:02.234 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000250654 s, 2.0 MB/s 2024-09-05T07:43:02.235 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T07:43:02.294 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-05T07:43:02.350 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-05 07:42:40.557326335 +0000 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-05 07:37:36.006791524 +0000 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-05 07:37:36.006791524 +0000 2024-09-05T07:43:02.351 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-05 07:37:36.006791524 +0000 2024-09-05T07:43:02.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T07:43:02.416 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-05T07:43:02.416 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-05T07:43:02.416 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000250516 s, 2.0 MB/s 2024-09-05T07:43:02.417 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T07:43:02.475 INFO:tasks.cephadm:Deploying osd.0 on smithi144 with /dev/vg_nvme/lv_4... 2024-09-05T07:43:02.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:02.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:02.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:02.620 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:02.621 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:02.837 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:43:03.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: Reconfiguring mon.b (monmap changed)... 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: Reconfiguring daemon mon.b on smithi154 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:03.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: Reconfiguring mon.b (monmap changed)... 2024-09-05T07:43:03.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: Reconfiguring daemon mon.b on smithi154 2024-09-05T07:43:03.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:03.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:03.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: Reconfiguring mon.b (monmap changed)... 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: Reconfiguring daemon mon.b on smithi154 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T07:43:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T07:43:03.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.543 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: Reconfiguring mon.c (monmap changed)... 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: Reconfiguring daemon mon.c on smithi175 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:04.544 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: Reconfiguring mon.c (monmap changed)... 2024-09-05T07:43:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: Reconfiguring daemon mon.c on smithi175 2024-09-05T07:43:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: Reconfiguring mon.c (monmap changed)... 2024-09-05T07:43:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: Reconfiguring daemon mon.c on smithi175 2024-09-05T07:43:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:04.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:05.652 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:05 smithi175 ceph-mon[34585]: Deploying daemon mgr.z on smithi175 2024-09-05T07:43:05.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:05 smithi154 ceph-mon[34710]: Deploying daemon mgr.z on smithi175 2024-09-05T07:43:05.763 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:05 smithi144 ceph-mon[29535]: Deploying daemon mgr.z on smithi175 2024-09-05T07:43:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:43:05.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2024-09-05T07:43:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:43:06.567 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:06 smithi144 ceph-mon[29535]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:06.643 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-mon[34585]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:06.643 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:06.549+0000 7f743cee2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 -- 172.21.15.144:0/3256329632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 msgr2=0x7f9404074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 --2- 172.21.15.144:0/3256329632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f9404074680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ca0 tx=0x7f93f402a8b0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 -- 172.21.15.144:0/3256329632 shutdown_connections 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 --2- 172.21.15.144:0/3256329632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9404074c50 0x7f94040750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 --2- 172.21.15.144:0/3256329632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f940410e020 0x7f9404110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 --2- 172.21.15.144:0/3256329632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f9404074680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 -- 172.21.15.144:0/3256329632 >> 172.21.15.144:0/3256329632 conn(0x7f94040fd1f0 msgr2=0x7f94040ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 -- 172.21.15.144:0/3256329632 shutdown_connections 2024-09-05T07:43:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.684+0000 7f940a600640 1 -- 172.21.15.144:0/3256329632 wait complete. 2024-09-05T07:43:06.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.685+0000 7f940a600640 1 Processor -- start 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.685+0000 7f940a600640 1 -- start start 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9404074c50 0x7f940419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f940410e020 0x7f94041a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9404113d30 con 0x7f9404074c50 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9404113bb0 con 0x7f940410e020 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f940a600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9404113eb0 con 0x7f9404076220 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f9409200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9404074c50 0x7f940419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:40260/0 (socket says 172.21.15.144:40260) 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 -- 172.21.15.144:0/2586731584 learned_addr learned my addr 172.21.15.144:0/2586731584 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:43:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f9409c00640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f940410e020 0x7f94041a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:06.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:06 smithi154 ceph-mon[34710]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 -- 172.21.15.144:0/2586731584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f940410e020 msgr2=0x7f94041a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f940410e020 0x7f94041a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 -- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9404074c50 msgr2=0x7f940419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9404074c50 0x7f940419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 -- 172.21.15.144:0/2586731584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94041a5f50 con 0x7f9404076220 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.686+0000 7f93fbe00640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e9f0 tx=0x7f93f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.687+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f000cd80 con 0x7f9404076220 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.687+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f0010910 con 0x7f9404076220 2024-09-05T07:43:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.687+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0018990 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.687+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94041a6240 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.687+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041a67d0 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.688+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f93f0018b30 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.688+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94041040d0 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.688+0000 7f9402000640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 0x7f93e803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.688+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f93f004c8e0 con 0x7f9404076220 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.689+0000 7f9409200640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 0x7f93e803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.689+0000 7f9409200640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 0x7f93e803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000f80 tx=0x7f93f4005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:06.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.694+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93f0018e20 con 0x7f9404076220 2024-09-05T07:43:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:06.880+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9404062630 con 0x7f93e80392c0 2024-09-05T07:43:06.972 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:06.609+0000 7f743cee2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:43:06.972 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:06.758+0000 7f743cee2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:43:06.972 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:06.823+0000 7f743cee2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:43:06.972 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:06.970+0000 7f743cee2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:43:07.337 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:07.109+0000 7f743cee2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:07.421+0000 7f743cee2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:07.482+0000 7f743cee2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:07.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: Deploying daemon mgr.y on smithi154 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-mon[34585]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:07.719 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: Deploying daemon mgr.y on smithi154 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:07.720 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.721 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:07 smithi144 ceph-mon[29535]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:07.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: Deploying daemon mgr.y on smithi154 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:07.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:07 smithi154 ceph-mon[34710]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:08.045 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:07.672+0000 7f743cee2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:43:08.596 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 systemd[1]: Starting Ceph mgr.y for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:43:08.859 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 podman[36066]: 2024-09-05 07:43:08.498705142 +0000 UTC m=+0.015736606 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:43:08.859 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 podman[36066]: 2024-09-05 07:43:08.604600601 +0000 UTC m=+0.121632106 container create 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-05T07:43:08.859 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 podman[36066]: 2024-09-05 07:43:08.83206189 +0000 UTC m=+0.349093358 container init 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T07:43:08.859 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 podman[36066]: 2024-09-05 07:43:08.834752144 +0000 UTC m=+0.351783606 container start 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-05T07:43:08.859 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 ceph-mgr[36085]: -- 172.21.15.154:0/1694598741 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4cc91b0e0 con 0x55b4cc8f9000 2024-09-05T07:43:09.087 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:08 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:08.586+0000 7f743cee2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:43:09.087 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:08 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:08.654+0000 7f743cee2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:43:09.170 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 bash[36066]: 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 2024-09-05T07:43:09.170 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 systemd[1]: Started Ceph mgr.y for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:43:09.171 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:08 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:08.956+0000 7f76f5e15040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:43:09.171 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.017+0000 7f76f5e15040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:43:09.171 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.170+0000 7f76f5e15040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:43:09.437 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.240+0000 7f76f5e15040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:43:09.437 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.392+0000 7f76f5e15040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:43:09.683 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.388+0000 7f743cee2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:43:09.683 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.528+0000 7f743cee2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:43:09.683 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.681+0000 7f743cee2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:43:09.878 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.553+0000 7f76f5e15040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:43:09.878 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.878+0000 7f76f5e15040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:43:09.937 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.745+0000 7f743cee2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:43:09.937 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.906+0000 7f743cee2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:43:10.129 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:09.940+0000 7f76f5e15040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:43:10.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.130 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1987623865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]': finished 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T07:43:10.131 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:09.976+0000 7f743cee2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.038+0000 7f743cee2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.206+0000 7f743cee2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.208 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1987623865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]': finished 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T07:43:10.209 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:10.259 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.259 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.259 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.259 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1987623865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]: dispatch 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c52fde6-9ed3-449b-8766-8d9e061d3cd8"}]': finished 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T07:43:10.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:10.437 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:10 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:10.128+0000 7f76f5e15040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:43:10.491 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.277+0000 7f743cee2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:43:10.491 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.343+0000 7f743cee2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:43:10.491 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.429+0000 7f743cee2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:43:10.491 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.489+0000 7f743cee2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:43:10.837 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:10.550+0000 7f743cee2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:43:11.437 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:11.030+0000 7f76f5e15040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:43:11.437 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:11.097+0000 7f76f5e15040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2221603511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:11.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:11 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2221603511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:11.587 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z[36390]: 2024-09-05T07:43:11.331+0000 7f743cee2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:43:11.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:11.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:11.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:11 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2221603511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:12.075 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:11.817+0000 7f76f5e15040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:43:12.075 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:11.932+0000 7f76f5e15040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:43:12.075 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.074+0000 7f76f5e15040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:43:12.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:12.214+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f93f004ecd0 con 0x7f9404076220 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: Standby manager daemon z started 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:12.355 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.136+0000 7f76f5e15040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:43:12.356 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.286+0000 7f76f5e15040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:43:12.356 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.354+0000 7f76f5e15040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:43:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:12.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: Standby manager daemon z started 2024-09-05T07:43:12.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T07:43:12.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:12.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T07:43:12.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:12 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:12.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:12.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: Standby manager daemon z started 2024-09-05T07:43:12.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T07:43:12.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:12.590 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T07:43:12.590 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:12 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.175:0/423744537' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:12.638 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.414+0000 7f76f5e15040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:43:12.639 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.573+0000 7f76f5e15040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:43:12.639 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.638+0000 7f76f5e15040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:43:12.904 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.704+0000 7f76f5e15040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:43:12.904 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.786+0000 7f76f5e15040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:43:12.904 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.845+0000 7f76f5e15040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:43:12.904 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:12.903+0000 7f76f5e15040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:43:13.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:13 smithi144 ceph-mon[29535]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-05T07:43:13.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:13 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T07:43:13.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:13 smithi175 ceph-mon[34585]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-05T07:43:13.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:13 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T07:43:13.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:13 smithi154 ceph-mon[34710]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-05T07:43:13.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:13 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T07:43:14.187 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:43:13 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y[36081]: 2024-09-05T07:43:13.691+0000 7f76f5e15040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:43:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:14.228+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mon.1 v2:172.21.15.175:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f93f0010430 con 0x7f9404076220 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: Standby manager daemon y started 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T07:43:14.491 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:14 smithi144 ceph-mon[29535]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: Standby manager daemon y started 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T07:43:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:14 smithi175 ceph-mon[34585]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: Standby manager daemon y started 2024-09-05T07:43:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T07:43:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T07:43:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T07:43:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:14 smithi154 ceph-mon[34710]: from='mgr.? 172.21.15.154:0/3807921236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T07:43:15.525 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:15 smithi144 ceph-mon[29535]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-05T07:43:15.525 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T07:43:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:15 smithi175 ceph-mon[34585]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-05T07:43:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T07:43:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:15 smithi154 ceph-mon[34710]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-05T07:43:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T07:43:16.469 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:16 smithi144 ceph-mon[29535]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:16.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:16 smithi175 ceph-mon[34585]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:16 smithi154 ceph-mon[34710]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:18.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:18 smithi144 ceph-mon[29535]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:18.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:18 smithi154 ceph-mon[34710]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:18 smithi175 ceph-mon[34585]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:19.493 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T07:43:19.493 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:19.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:19 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T07:43:19.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:19 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:19.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:19 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T07:43:19.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:19 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:20.527 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:20 smithi144 ceph-mon[29535]: Deploying daemon osd.0 on smithi144 2024-09-05T07:43:20.527 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:20 smithi144 ceph-mon[29535]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:20 smithi175 ceph-mon[34585]: Deploying daemon osd.0 on smithi144 2024-09-05T07:43:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:20 smithi175 ceph-mon[34585]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:20 smithi154 ceph-mon[34710]: Deploying daemon osd.0 on smithi144 2024-09-05T07:43:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:20 smithi154 ceph-mon[34710]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:22.354 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:22 smithi144 ceph-mon[29535]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:22 smithi175 ceph-mon[34585]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:22 smithi154 ceph-mon[34710]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:24.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:24 smithi144 ceph-mon[29535]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:24 smithi175 ceph-mon[34585]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:24 smithi154 ceph-mon[34710]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:25.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:25.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:25.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:26.541 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:26 smithi175 ceph-mon[34585]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:26 smithi144 ceph-mon[29535]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:26 smithi154 ceph-mon[34710]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:28.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:28.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.788+0000 7f9402000640 1 -- 172.21.15.144:0/2586731584 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9404062630 con 0x7f93e80392c0 2024-09-05T07:43:29.789 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 0 on host 'smithi144' 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 msgr2=0x7f93e803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 0x7f93e803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000f80 tx=0x7f93f4005f30 comp rx=0 tx=0).stop 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 msgr2=0x7f940419e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e9f0 tx=0x7f93f000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 shutdown_connections 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f93e80392c0 0x7f93e803b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f940410e020 0x7f94041a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9404076220 0x7f940419e860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 --2- 172.21.15.144:0/2586731584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9404074c50 0x7f940419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 >> 172.21.15.144:0/2586731584 conn(0x7f94040fd1f0 msgr2=0x7f94041012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:43:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 shutdown_connections 2024-09-05T07:43:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:43:29.790+0000 7f940a600640 1 -- 172.21.15.144:0/2586731584 wait complete. 2024-09-05T07:43:30.380 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:30 smithi144 ceph-mon[29535]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:30.380 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:30.380 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.381 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.529 DEBUG:teuthology.orchestra.run.smithi144:osd.0> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.0.service 2024-09-05T07:43:30.534 INFO:tasks.cephadm:Deploying osd.1 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-05T07:43:30.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T07:43:30.563 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:30 smithi154 ceph-mon[34710]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:30.563 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:30.563 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.563 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:30 smithi175 ceph-mon[34585]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:30.784 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:43:30.983 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:43:30 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:43:30.965+0000 7f0ae2822640 -1 osd.0 0 log_to_monitors true 2024-09-05T07:43:31.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:31 smithi144 ceph-mon[29535]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T07:43:31.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:31 smithi175 ceph-mon[34585]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T07:43:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:31 smithi154 ceph-mon[34710]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T07:43:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:32 smithi154 ceph-mon[34710]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:32 smithi154 ceph-mon[34710]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T07:43:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:32 smithi154 ceph-mon[34710]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T07:43:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:32 smithi154 ceph-mon[34710]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:43:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:32.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-mon[29535]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:32.467 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-mon[29535]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T07:43:32.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-mon[29535]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T07:43:32.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-mon[29535]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:43:32.468 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:32 smithi175 ceph-mon[34585]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:32 smithi175 ceph-mon[34585]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T07:43:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:32 smithi175 ceph-mon[34585]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T07:43:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:32 smithi175 ceph-mon[34585]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:43:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.071 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:43:32.776+0000 7f0adde00640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T07:43:33.072 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:43:32 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:43:32.798+0000 7f0ad3400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:43:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:43:33.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-05T07:43:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:33 smithi154 ceph-mon[34710]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:43:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:33 smithi154 ceph-mon[34710]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T07:43:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:33 smithi154 ceph-mon[34710]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' 2024-09-05T07:43:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:43:33.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:33 smithi144 ceph-mon[29535]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:43:33.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:33 smithi144 ceph-mon[29535]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T07:43:33.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.540 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:33 smithi144 ceph-mon[29535]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' 2024-09-05T07:43:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:33 smithi175 ceph-mon[34585]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:43:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:33 smithi175 ceph-mon[34585]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T07:43:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:33 smithi175 ceph-mon[34585]: from='osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534]' entity='osd.0' 2024-09-05T07:43:34.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 -- 172.21.15.154:0/821750874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 msgr2=0x7ff78c1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 --2- 172.21.15.154:0/821750874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1073e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff780009900 tx=0x7ff78002a410 comp rx=0 tx=0).stop 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 -- 172.21.15.154:0/821750874 shutdown_connections 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 --2- 172.21.15.154:0/821750874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1073e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 --2- 172.21.15.154:0/821750874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 --2- 172.21.15.154:0/821750874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 -- 172.21.15.154:0/821750874 >> 172.21.15.154:0/821750874 conn(0x7ff78c0fc280 msgr2=0x7ff78c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 -- 172.21.15.154:0/821750874 shutdown_connections 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.002+0000 7ff792321640 1 -- 172.21.15.154:0/821750874 wait complete. 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 Processor -- start 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 -- start start 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:34.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c10d850 con 0x7ff78c107920 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c10d6d0 con 0x7ff78c104ff0 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff792321640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c10d9d0 con 0x7ff78c1026c0 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff78b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff78b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50774/0 (socket says 172.21.15.154:50774) 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.003+0000 7ff78b7fe640 1 -- 172.21.15.154:0/2340651875 learned_addr learned my addr 172.21.15.154:0/2340651875 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff7908be640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78bfff640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 -- 172.21.15.154:0/2340651875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 msgr2=0x7ff78c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 -- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 msgr2=0x7ff78c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 -- 172.21.15.154:0/2340651875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c19fb90 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78bfff640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff7908be640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff78b7fe640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff780031610 tx=0x7ff7800043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78003f030 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c19fe20 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff780003ce0 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780035070 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.004+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c1a0280 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.005+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c0fdd70 con 0x7ff78c104ff0 2024-09-05T07:43:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.007+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7ff780042030 con 0x7ff78c104ff0 2024-09-05T07:43:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.008+0000 7ff7897fa640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 0x7ff7740a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.008+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7ff7800eddb0 con 0x7ff78c104ff0 2024-09-05T07:43:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.009+0000 7ff78bfff640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 0x7ff7740a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.009+0000 7ff78bfff640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 0x7ff7740a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0058c0 tx=0x7ff77c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.011+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7800bc780 con 0x7ff78c104ff0 2024-09-05T07:43:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:34.191+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff78c062630 con 0x7ff7740a2b20 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] boot 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] boot 2024-09-05T07:43:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T07:43:34.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:34.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:34.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:34.611 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: osd.0 [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] boot 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:34.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi144 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi144 to 17089M 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:35.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:35.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:35 smithi144 ceph-mon[29535]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi144 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi144 to 17089M 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:35.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:35.586 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.586 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:35 smithi154 ceph-mon[34710]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi144 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi144 to 17089M 2024-09-05T07:43:35.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:35.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:35.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:35.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:35 smithi175 ceph-mon[34585]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T07:43:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:36 smithi154 ceph-mon[34710]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:36.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:36 smithi144 ceph-mon[29535]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:36 smithi175 ceph-mon[34585]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:37.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/2279518508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]': finished 2024-09-05T07:43:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T07:43:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:37 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/327275213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/2279518508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]': finished 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:37 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/327275213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/2279518508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]: dispatch 2024-09-05T07:43:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b29546a-9c89-436e-8088-5a87b65a9b3c"}]': finished 2024-09-05T07:43:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T07:43:37.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:37.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:37 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/327275213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:43:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:38 smithi144 ceph-mon[29535]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:38 smithi175 ceph-mon[34585]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:38 smithi154 ceph-mon[34710]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:40.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:40 smithi144 ceph-mon[29535]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:40 smithi175 ceph-mon[34585]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:40 smithi154 ceph-mon[34710]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:42.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:42 smithi154 ceph-mon[34710]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:42 smithi175 ceph-mon[34585]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:42.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:42 smithi144 ceph-mon[29535]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:44 smithi175 ceph-mon[34585]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:44.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:44 smithi154 ceph-mon[34710]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:44.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:44 smithi144 ceph-mon[29535]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:45.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:45 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T07:43:45.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:45 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:45.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:45 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T07:43:45.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:45 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:45.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:45 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T07:43:45.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:45 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:46.414 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:46 smithi154 ceph-mon[34710]: Deploying daemon osd.1 on smithi154 2024-09-05T07:43:46.415 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:46 smithi154 ceph-mon[34710]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:46.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:46 smithi144 ceph-mon[29535]: Deploying daemon osd.1 on smithi154 2024-09-05T07:43:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:46 smithi144 ceph-mon[29535]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:46 smithi175 ceph-mon[34585]: Deploying daemon osd.1 on smithi154 2024-09-05T07:43:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:46 smithi175 ceph-mon[34585]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:48 smithi154 ceph-mon[34710]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:48 smithi144 ceph-mon[29535]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:48 smithi175 ceph-mon[34585]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:50.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:50 smithi154 ceph-mon[34710]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:50.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:50.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:50.416 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:50 smithi144 ceph-mon[29535]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:50 smithi175 ceph-mon[34585]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:53.560 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 1 on host 'smithi154' 2024-09-05T07:43:53.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.559+0000 7ff7897fa640 1 -- 172.21.15.154:0/2340651875 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff78c062630 con 0x7ff7740a2b20 2024-09-05T07:43:53.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 msgr2=0x7ff7740a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:53.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 0x7ff7740a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0058c0 tx=0x7ff77c005850 comp rx=0 tx=0).stop 2024-09-05T07:43:53.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 msgr2=0x7ff78c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff780031610 tx=0x7ff7800043b0 comp rx=0 tx=0).stop 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 shutdown_connections 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff7740a2b20 0x7ff7740a4fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff78c104ff0 0x7ff78c1984a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c107920 0x7ff78c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 --2- 172.21.15.154:0/2340651875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78c1026c0 0x7ff78c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 >> 172.21.15.154:0/2340651875 conn(0x7ff78c0fc280 msgr2=0x7ff78c103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:43:53.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 shutdown_connections 2024-09-05T07:43:53.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:43:53.562+0000 7ff792321640 1 -- 172.21.15.154:0/2340651875 wait complete. 2024-09-05T07:43:54.263 DEBUG:teuthology.orchestra.run.smithi154:osd.1> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.1.service 2024-09-05T07:43:54.265 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-09-05T07:43:54.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T07:43:54.518 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:43:54.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:54 smithi154 ceph-mon[34710]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:54.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:54.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:54.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:54 smithi175 ceph-mon[34585]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:54.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:54 smithi144 ceph-mon[29535]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:54.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:43:54.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:54.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:56.301 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:43:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:43:56.021+0000 7f1375fe9640 -1 osd.1 0 log_to_monitors true 2024-09-05T07:43:56.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:56 smithi154 ceph-mon[34710]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:56.608 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:56 smithi154 ceph-mon[34710]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.608 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:56 smithi154 ceph-mon[34710]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.624 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:56 smithi144 ceph-mon[29535]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:56.624 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:56 smithi144 ceph-mon[29535]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.624 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:56 smithi144 ceph-mon[29535]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:56 smithi175 ceph-mon[34585]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:56.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:56 smithi175 ceph-mon[34585]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:56 smithi175 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T07:43:56.790 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:43:56.816 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-09-05T07:43:57.062 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:57.442 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 -- 172.21.15.175:0/378254195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe41026a0 msgr2=0x7f5fe4104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/378254195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe41026a0 0x7f5fe4104a90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009900 tx=0x7f5fd402a410 comp rx=0 tx=0).stop 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 -- 172.21.15.175:0/378254195 shutdown_connections 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/378254195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4107900 0x7f5fe4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/378254195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/378254195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe41026a0 0x7f5fe4104a90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 -- 172.21.15.175:0/378254195 >> 172.21.15.175:0/378254195 conn(0x7f5fe40fc2a0 msgr2=0x7f5fe40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 -- 172.21.15.175:0/378254195 shutdown_connections 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.527+0000 7f5fe96ff640 1 -- 172.21.15.175:0/378254195 wait complete. 2024-09-05T07:43:57.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 Processor -- start 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 -- start start 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe41026a0 0x7f5fe4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4107900 0x7f5fe419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe410d900 con 0x7f5fe4107900 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe410d780 con 0x7f5fe41026a0 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe96ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe410da80 con 0x7f5fe4104fd0 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fdbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fdbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:57640/0 (socket says 172.21.15.175:57640) 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fdbfff640 1 -- 172.21.15.175:0/2949326736 learned_addr learned my addr 172.21.15.175:0/2949326736 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:43:57.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe2ffd640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe41026a0 0x7f5fe4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.528+0000 7f5fe37fe640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4107900 0x7f5fe419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 -- 172.21.15.175:0/2949326736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe41026a0 msgr2=0x7f5fe4197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe41026a0 0x7f5fe4197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 -- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4107900 msgr2=0x7f5fe419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4107900 0x7f5fe419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 -- 172.21.15.175:0/2949326736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe419fb90 con 0x7f5fe4104fd0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fdbfff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c970 tx=0x7f5fcc00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc007bb0 con 0x7f5fe4104fd0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe419fe80 con 0x7f5fe4104fd0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fcc007d50 con 0x7f5fe4104fd0 2024-09-05T07:43:57.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00f450 con 0x7f5fe4104fd0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.529+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe41a0330 con 0x7f5fe4104fd0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.530+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe40fdd90 con 0x7f5fe4104fd0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.531+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f5fcc004f50 con 0x7f5fe4104fd0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.532+0000 7f5fe0ff9640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 0x7f5fd00a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.532+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f5fcc0cd3e0 con 0x7f5fe4104fd0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.532+0000 7f5fe2ffd640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 0x7f5fd00a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.532+0000 7f5fe2ffd640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 0x7f5fd00a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4031440 tx=0x7f5fd40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:43:57.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.536+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fcc014030 con 0x7f5fe4104fd0 2024-09-05T07:43:57.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T07:43:57.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T07:43:57.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:57.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:57.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T07:43:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T07:43:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:43:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:43:57.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:43:57.712+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5fe4062630 con 0x7f5fd00a2b20 2024-09-05T07:43:58.187 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:43:57.766+0000 7f1371f6c640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T07:43:58.187 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:43:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:43:57.769+0000 7f1369d8c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:43:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi154 2024-09-05T07:43:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:58 smithi154 ceph-mon[34710]: from='osd.1 ' entity='osd.1' 2024-09-05T07:43:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi154 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:58.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:58 smithi144 ceph-mon[29535]: from='osd.1 ' entity='osd.1' 2024-09-05T07:43:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi154 2024-09-05T07:43:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-05T07:43:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:43:58.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:58 smithi175 ceph-mon[34585]: from='osd.1 ' entity='osd.1' 2024-09-05T07:43:59.572 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:43:59.572 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:43:59.572 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:59.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:59.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] boot 2024-09-05T07:43:59.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T07:43:59.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:43:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:43:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:43:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] boot 2024-09-05T07:43:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T07:43:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:43:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:59.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: osd.1 [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] boot 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T07:43:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:43:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: osdmap e14: 2 total, 2 up, 2 in 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2762429770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]': finished 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T07:44:00.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:00 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:44:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: osdmap e14: 2 total, 2 up, 2 in 2024-09-05T07:44:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/2762429770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]': finished 2024-09-05T07:44:00.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T07:44:00.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:00 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T07:44:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: osdmap e14: 2 total, 2 up, 2 in 2024-09-05T07:44:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2762429770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]: dispatch 2024-09-05T07:44:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5835e07e-341b-4071-acc0-6d1de7f931a1"}]': finished 2024-09-05T07:44:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T07:44:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:00 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:01.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:01 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/2151772206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:01 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2151772206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:01 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2151772206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:02 smithi154 ceph-mon[34710]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:02 smithi144 ceph-mon[29535]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:02 smithi175 ceph-mon[34585]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:04 smithi154 ceph-mon[34710]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:04.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:04 smithi175 ceph-mon[34585]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:04 smithi144 ceph-mon[29535]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:06.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:06 smithi154 ceph-mon[34710]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:06.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:06 smithi175 ceph-mon[34585]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:06 smithi144 ceph-mon[29535]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:08 smithi144 ceph-mon[29535]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T07:44:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:08 smithi175 ceph-mon[34585]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T07:44:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:08 smithi154 ceph-mon[34710]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T07:44:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:09.472 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:09 smithi175 ceph-mon[34585]: Deploying daemon osd.2 on smithi175 2024-09-05T07:44:09.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:09 smithi154 ceph-mon[34710]: Deploying daemon osd.2 on smithi175 2024-09-05T07:44:09.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:09 smithi144 ceph-mon[29535]: Deploying daemon osd.2 on smithi175 2024-09-05T07:44:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:10 smithi175 ceph-mon[34585]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:10 smithi154 ceph-mon[34710]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:10.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:10 smithi144 ceph-mon[29535]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:12 smithi175 ceph-mon[34585]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:12 smithi154 ceph-mon[34710]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:12 smithi144 ceph-mon[29535]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:13.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:13 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:13.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:13 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:13.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:13 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:13.721 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:13 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:13.721 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:13 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:13.721 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:13 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:13.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:13 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:13.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:13 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:13.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:13 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:14 smithi154 ceph-mon[34710]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:14.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:14 smithi175 ceph-mon[34585]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:14 smithi144 ceph-mon[29535]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:16.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:16.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:16.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:16.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:16.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.751 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-09-05T07:44:16.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.749+0000 7f5fe0ff9640 1 -- 172.21.15.175:0/2949326736 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5fe4062630 con 0x7f5fd00a2b20 2024-09-05T07:44:16.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 msgr2=0x7f5fd00a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 0x7f5fd00a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4031440 tx=0x7f5fd40315b0 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 msgr2=0x7f5fe41984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c970 tx=0x7f5fcc00ce30 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 shutdown_connections 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5fd00a2b20 0x7f5fd00a4fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe4107900 0x7f5fe419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4104fd0 0x7f5fe41984a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 --2- 172.21.15.175:0/2949326736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe41026a0 0x7f5fe4197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 >> 172.21.15.175:0/2949326736 conn(0x7f5fe40fc2a0 msgr2=0x7f5fe4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 shutdown_connections 2024-09-05T07:44:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:44:16.752+0000 7f5fe96ff640 1 -- 172.21.15.175:0/2949326736 wait complete. 2024-09-05T07:44:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:16.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:16.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:16.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.390 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.2.service 2024-09-05T07:44:17.393 INFO:tasks.cephadm:Deploying osd.3 on smithi144 with /dev/vg_nvme/lv_3... 2024-09-05T07:44:17.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T07:44:17.685 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:17.685 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:44:17.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:17.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:17.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:18.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:18 smithi175 ceph-mon[34585]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:18.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:18 smithi144 ceph-mon[29535]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:18 smithi154 ceph-mon[34710]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:19.338 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:44:19.278+0000 7f0856de5640 -1 osd.2 0 log_to_monitors true 2024-09-05T07:44:19.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:19 smithi144 ceph-mon[29535]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:19.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:19 smithi144 ceph-mon[29535]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:19.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:19 smithi154 ceph-mon[34710]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:19.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:19 smithi154 ceph-mon[34710]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:19.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:19 smithi175 ceph-mon[34585]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:19.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:19 smithi175 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T07:44:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T07:44:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:20.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:20.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:20 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:20.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:20 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:20.865 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:44:20.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2024-09-05T07:44:21.087 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:44:20.814+0000 7f0852d68640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T07:44:21.087 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:44:20.818+0000 7f084ab88640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:44:21.289 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi175 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: from='osd.2 ' entity='osd.2' 2024-09-05T07:44:21.718 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:21 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi175 2024-09-05T07:44:21.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-05T07:44:21.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:44:21.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T07:44:21.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: from='osd.2 ' entity='osd.2' 2024-09-05T07:44:21.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:21 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 -- 172.21.15.144:0/1649895501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8103c50 msgr2=0x7f51b8104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 --2- 172.21.15.144:0/1649895501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8103c50 0x7f51b8104050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009860 tx=0x7f51a802a340 comp rx=0 tx=0).stop 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 -- 172.21.15.144:0/1649895501 shutdown_connections 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 --2- 172.21.15.144:0/1649895501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 --2- 172.21.15.144:0/1649895501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8104e50 0x7f51b81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 --2- 172.21.15.144:0/1649895501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8103c50 0x7f51b8104050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:21.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 -- 172.21.15.144:0/1649895501 >> 172.21.15.144:0/1649895501 conn(0x7f51b80ff3e0 msgr2=0x7f51b8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 -- 172.21.15.144:0/1649895501 shutdown_connections 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.841+0000 7f51b7200640 1 -- 172.21.15.144:0/1649895501 wait complete. 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.842+0000 7f51b7200640 1 Processor -- start 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.842+0000 7f51b7200640 1 -- start start 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8104e50 0x7f51b819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b81a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810f8b0 con 0x7f51b8103c50 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810f730 con 0x7f51b8105810 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810fa30 con 0x7f51b8104e50 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:21.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60162/0 (socket says 172.21.15.144:60162) 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 -- 172.21.15.144:0/2335622190 learned_addr learned my addr 172.21.15.144:0/2335622190 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5400640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8104e50 0x7f51b819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b6800640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b81a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 -- 172.21.15.144:0/2335622190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8104e50 msgr2=0x7f51b819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8104e50 0x7f51b819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 -- 172.21.15.144:0/2335622190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 msgr2=0x7f51b81a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b81a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b5e00640 1 -- 172.21.15.144:0/2335622190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b81a1b60 con 0x7f51b8103c50 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.843+0000 7f51b6800640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b81a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51b5e00640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51a80305b0 tx=0x7f51a8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a803f020 con 0x7f51b8103c50 2024-09-05T07:44:21.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a8032750 con 0x7f51b8103c50 2024-09-05T07:44:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b81a1df0 con 0x7f51b8103c50 2024-09-05T07:44:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8037040 con 0x7f51b8103c50 2024-09-05T07:44:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.844+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b81a2210 con 0x7f51b8103c50 2024-09-05T07:44:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.845+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b810b070 con 0x7f51b8103c50 2024-09-05T07:44:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.847+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f51a8042020 con 0x7f51b8103c50 2024-09-05T07:44:21.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.848+0000 7f51aea00640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 0x7f519c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:21.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.848+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f51a80ede00 con 0x7f51b8103c50 2024-09-05T07:44:21.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.848+0000 7f51b5400640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 0x7f519c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:21.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.849+0000 7f51b5400640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 0x7f519c0a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51b819b450 tx=0x7f51a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:44:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:21.852+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51a8049020 con 0x7f51b8103c50 2024-09-05T07:44:21.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi175 2024-09-05T07:44:21.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-05T07:44:21.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:44:21.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T07:44:21.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:21.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: from='osd.2 ' entity='osd.2' 2024-09-05T07:44:21.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:21 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:22.036+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f51b8062630 con 0x7f519c0a2b20 2024-09-05T07:44:22.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:44:22.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:44:22.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:22.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] boot 2024-09-05T07:44:22.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T07:44:22.724 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:22.724 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:22.724 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:22.724 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:44:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] boot 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:22.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:22.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:44:22.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: osd.2 [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] boot 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:22.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:23.964 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:23 smithi144 ceph-mon[29535]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:23.964 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:23 smithi144 ceph-mon[29535]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T07:44:24.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:23 smithi175 ceph-mon[34585]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:24.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:23 smithi175 ceph-mon[34585]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T07:44:24.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:23 smithi154 ceph-mon[34710]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:24.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:23 smithi154 ceph-mon[34710]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T07:44:25.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:24 smithi144 ceph-mon[29535]: pgmap v78: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:25.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:25.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:24 smithi144 ceph-mon[29535]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T07:44:25.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:24 smithi175 ceph-mon[34585]: pgmap v78: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:24 smithi175 ceph-mon[34585]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T07:44:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:24 smithi154 ceph-mon[34710]: pgmap v78: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:25.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:25.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:24 smithi154 ceph-mon[34710]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T07:44:25.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:44:25.707 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:25 smithi144 sudo[48230]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:25.708 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:25 smithi144 sudo[48230]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:25.708 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:25 smithi144 sudo[48230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:25.708 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:25 smithi144 sudo[48230]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:26.020 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]: dispatch 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]': finished 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:26.021 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/947064705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:26.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:26.052+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f51a8030850 con 0x7f51b8103c50 2024-09-05T07:44:26.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:26.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T07:44:26.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]: dispatch 2024-09-05T07:44:26.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]': finished 2024-09-05T07:44:26.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T07:44:26.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:26.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:26.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:25 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/947064705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:26.321 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:26 smithi144 sudo[48256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:26.322 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:26 smithi144 sudo[48256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:26.322 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:26 smithi144 sudo[48256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:26.322 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:44:26 smithi144 sudo[48256]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]: dispatch 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2719419141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5dc8b828-3d7f-4248-b39e-5c5edc7650e0"}]': finished 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:26.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:25 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/947064705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:26.560 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43114]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:26.560 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43114]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:26.560 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:26.561 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43114]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:26.938 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43117]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:26.938 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:26.938 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:26.938 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:44:26 smithi154 sudo[43117]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:27.086 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:26 smithi175 sudo[43401]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:27.086 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:26 smithi175 sudo[43401]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:27.086 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:26 smithi175 sudo[43401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:27.086 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:26 smithi175 sudo[43401]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:27.086 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:27 smithi175 ceph-mon[34585]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T07:44:27.086 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:27.086 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:27.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 ceph-mon[29535]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T07:44:27.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:27.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:27.337 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:27 smithi175 sudo[43404]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:27.337 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:27 smithi175 sudo[43404]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:27.337 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:27 smithi175 sudo[43404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:27.337 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:44:27 smithi175 sudo[43404]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:27.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:27 smithi154 ceph-mon[34710]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T07:44:27.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:27.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:28.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 sudo[48663]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:28.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 sudo[48663]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:28.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 sudo[48663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:28.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:27 smithi144 sudo[48663]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:28.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:28.460 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:28.460 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43407]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:28.460 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43407]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:28.460 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:28.460 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43407]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:28.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 sudo[49039]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:28.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 sudo[49039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 sudo[49039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 sudo[49039]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:28.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:28 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43410]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43410]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:28 smithi175 sudo[43410]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:29.194 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 sudo[43120]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T07:44:29.194 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 sudo[43120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:29.195 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 sudo[43120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:29.195 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:28 smithi154 sudo[43120]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:29 smithi175 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:29.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:29 smithi144 ceph-mon[29535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 sudo[43123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T07:44:29.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 sudo[43123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 sudo[43123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 sudo[43123]: pam_unix(sudo:session): session closed for user root 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:29.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T07:44:29.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T07:44:29.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T07:44:29.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T07:44:29.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:29 smithi154 ceph-mon[34710]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T07:44:30.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:30 smithi144 ceph-mon[29535]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:30 smithi175 ceph-mon[34585]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:30 smithi154 ceph-mon[34710]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:32.456 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:32 smithi144 ceph-mon[29535]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:32 smithi175 ceph-mon[34585]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:32 smithi154 ceph-mon[34710]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:34 smithi144 ceph-mon[29535]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T07:44:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:34 smithi175 ceph-mon[34585]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T07:44:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:34 smithi154 ceph-mon[34710]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T07:44:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:35.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:35 smithi144 ceph-mon[29535]: Deploying daemon osd.3 on smithi144 2024-09-05T07:44:35.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:35 smithi175 ceph-mon[34585]: Deploying daemon osd.3 on smithi144 2024-09-05T07:44:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:35 smithi154 ceph-mon[34710]: Deploying daemon osd.3 on smithi144 2024-09-05T07:44:36.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:36 smithi144 ceph-mon[29535]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:36 smithi175 ceph-mon[34585]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:36 smithi154 ceph-mon[34710]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:38.457 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:38 smithi144 ceph-mon[29535]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:38 smithi175 ceph-mon[34585]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:38 smithi154 ceph-mon[34710]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:40 smithi144 ceph-mon[29535]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:40 smithi175 ceph-mon[34585]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:40 smithi154 ceph-mon[34710]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:41 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:41 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:41 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:41 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:41 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:41 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:41.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:41 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:41.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:41 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:41.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:41 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:42.537 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:42 smithi144 ceph-mon[29535]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:42 smithi175 ceph-mon[34585]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:42 smithi154 ceph-mon[34710]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:44.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:44.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:44.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:44.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:44.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:44.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.431+0000 7f51aea00640 1 -- 172.21.15.144:0/2335622190 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51b8062630 con 0x7f519c0a2b20 2024-09-05T07:44:45.431 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 3 on host 'smithi144' 2024-09-05T07:44:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 msgr2=0x7f519c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 0x7f519c0a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51b819b450 tx=0x7f51a4009260 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 msgr2=0x7f51b8199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51a80305b0 tx=0x7f51a8033d90 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 shutdown_connections 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f519c0a2b20 0x7f519c0a4fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b8105810 0x7f51b81a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51b8104e50 0x7f51b819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 --2- 172.21.15.144:0/2335622190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b8103c50 0x7f51b8199f30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.433+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 >> 172.21.15.144:0/2335622190 conn(0x7f51b80ff3e0 msgr2=0x7f51b8108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.434+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 shutdown_connections 2024-09-05T07:44:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:44:45.434+0000 7f51b7200640 1 -- 172.21.15.144:0/2335622190 wait complete. 2024-09-05T07:44:46.154 DEBUG:teuthology.orchestra.run.smithi144:osd.3> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.3.service 2024-09-05T07:44:46.158 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-05T07:44:46.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T07:44:46.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:46 smithi144 ceph-mon[29535]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:46.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:46.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:46.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:46.412 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:44:46.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:46 smithi154 ceph-mon[34710]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:46.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:46.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:46.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:46 smithi175 ceph-mon[34585]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:44:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:47.072 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:44:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:44:46.734+0000 7f61e2a39640 -1 osd.3 0 log_to_monitors true 2024-09-05T07:44:47.369 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:47 smithi144 ceph-mon[29535]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T07:44:47.503 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:47 smithi154 ceph-mon[34710]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T07:44:47.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:47 smithi175 ceph-mon[34585]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T07:44:48.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:48 smithi154 ceph-mon[34710]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:48.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:48 smithi154 ceph-mon[34710]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T07:44:48.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:48 smithi154 ceph-mon[34710]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T07:44:48.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:48 smithi154 ceph-mon[34710]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:44:48.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:48.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-mon[29535]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:48.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-mon[29535]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T07:44:48.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-mon[29535]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T07:44:48.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-mon[29535]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:44:48.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:48.594 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:48 smithi175 ceph-mon[34585]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:48.594 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:48 smithi175 ceph-mon[34585]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T07:44:48.594 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:48 smithi175 ceph-mon[34585]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T07:44:48.594 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:48 smithi175 ceph-mon[34585]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:44:48.594 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:44:48.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-05T07:44:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:44:49.244 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:44:48.825+0000 7f61dd200640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T07:44:49.244 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:44:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:44:48.854+0000 7f61d3200640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:44:49.512 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:44:49.512 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T07:44:49.512 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.512 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.512 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' 2024-09-05T07:44:49.513 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] boot 2024-09-05T07:44:49.513 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T07:44:49.513 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.569 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:44:49.569 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T07:44:49.569 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.569 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.569 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' 2024-09-05T07:44:49.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] boot 2024-09-05T07:44:49.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T07:44:49.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: from='osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794]' entity='osd.3' 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: osd.3 [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] boot 2024-09-05T07:44:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T07:44:49.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T07:44:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 -- 172.21.15.154:0/2529417603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8107960 msgr2=0x7fa2e8109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/2529417603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8107960 0x7fa2e8109d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009ca0 tx=0x7fa2e002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 -- 172.21.15.154:0/2529417603 shutdown_connections 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/2529417603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8107960 0x7fa2e8109d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/2529417603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8105030 0x7fa2e8107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/2529417603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8102700 0x7fa2e8104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 -- 172.21.15.154:0/2529417603 >> 172.21.15.154:0/2529417603 conn(0x7fa2e80fc2a0 msgr2=0x7fa2e80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 -- 172.21.15.154:0/2529417603 shutdown_connections 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.680+0000 7fa2eec9e640 1 -- 172.21.15.154:0/2529417603 wait complete. 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 Processor -- start 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 -- start start 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8102700 0x7fa2e8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 0x7fa2e819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e810d8a0 con 0x7fa2e8102700 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e810d720 con 0x7fa2e8105030 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eec9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e810da20 con 0x7fa2e8107960 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49000/0 (socket says 172.21.15.154:49000) 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2e7fff640 1 -- 172.21.15.154:0/1318099015 learned_addr learned my addr 172.21.15.154:0/1318099015 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2eca3a640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8102700 0x7fa2e8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.681+0000 7fa2ed23b640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 0x7fa2e819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 -- 172.21.15.154:0/1318099015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 msgr2=0x7fa2e819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 0x7fa2e819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 -- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8102700 msgr2=0x7fa2e8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8102700 0x7fa2e8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 -- 172.21.15.154:0/1318099015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e819fb20 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2ed23b640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 0x7fa2e819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e7fff640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400d770 tx=0x7fa2d400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4017070 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d4009c30 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e819fe10 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400f620 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.682+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e81a02c0 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.683+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e80fdd90 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.684+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa2d401a070 con 0x7fa2e8105030 2024-09-05T07:44:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.685+0000 7fa2e5ffb640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 0x7fa2d80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:44:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.685+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7fa2d40cdca0 con 0x7fa2e8105030 2024-09-05T07:44:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.685+0000 7fa2eca3a640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 0x7fa2d80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:44:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.686+0000 7fa2eca3a640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 0x7fa2d80a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00bbe0 tx=0x7fa2dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:44:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.689+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2d409be00 con 0x7fa2e8105030 2024-09-05T07:44:49.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:44:49.867+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa2e8062630 con 0x7fa2d80a2bb0 2024-09-05T07:44:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:44:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:44:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:50 smithi144 ceph-mon[29535]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T07:44:50.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:44:50.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:50.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:50.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:50 smithi175 ceph-mon[34585]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.602 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:44:50.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:44:50.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:44:50.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:44:50.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:44:50.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:50 smithi154 ceph-mon[34710]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T07:44:51.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:51 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi144 2024-09-05T07:44:51.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:51 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-05T07:44:51.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:51 smithi144 ceph-mon[29535]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:51.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:51 smithi144 ceph-mon[29535]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T07:44:51.565 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:51 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi144 2024-09-05T07:44:51.565 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:51 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-05T07:44:51.565 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:51 smithi154 ceph-mon[34710]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:51.565 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:51 smithi154 ceph-mon[34710]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T07:44:51.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:51 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi144 2024-09-05T07:44:51.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:51 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-05T07:44:51.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:51 smithi175 ceph-mon[34585]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:44:51.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:51 smithi175 ceph-mon[34585]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T07:44:52.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:52 smithi144 ceph-mon[29535]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:52 smithi175 ceph-mon[34585]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:52.633 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:52 smithi154 ceph-mon[34710]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: osdmap e28: 4 total, 4 up, 4 in 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/2767742670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]': finished 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:44:53.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:53 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/3567145649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: osdmap e28: 4 total, 4 up, 4 in 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/2767742670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]': finished 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:44:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:53 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/3567145649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: osdmap e28: 4 total, 4 up, 4 in 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/2767742670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]: dispatch 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5e2a66d-cac2-4cd1-8559-df0856070bf0"}]': finished 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:44:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:53 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/3567145649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:44:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:54 smithi154 ceph-mon[34710]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:54 smithi144 ceph-mon[29535]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:54 smithi175 ceph-mon[34585]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:44:56.650 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:56 smithi144 ceph-mon[29535]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:44:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:56 smithi154 ceph-mon[34710]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:44:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:56 smithi175 ceph-mon[34585]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:44:58.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:44:58 smithi175 ceph-mon[34585]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:44:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:44:58 smithi154 ceph-mon[34710]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:44:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:44:58 smithi144 ceph-mon[29535]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:45:00.599 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:00 smithi154 ceph-mon[34710]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:00 smithi144 ceph-mon[29535]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:00 smithi175 ceph-mon[34585]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:01.665 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T07:45:01.665 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:01.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T07:45:01.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T07:45:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:02.598 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:02 smithi154 ceph-mon[34710]: Deploying daemon osd.4 on smithi154 2024-09-05T07:45:02.598 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:02 smithi154 ceph-mon[34710]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T07:45:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:02 smithi144 ceph-mon[29535]: Deploying daemon osd.4 on smithi154 2024-09-05T07:45:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:02 smithi144 ceph-mon[29535]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T07:45:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:02 smithi175 ceph-mon[34585]: Deploying daemon osd.4 on smithi154 2024-09-05T07:45:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:02 smithi175 ceph-mon[34585]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-05T07:45:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:04 smithi154 ceph-mon[34710]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-05T07:45:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:04 smithi144 ceph-mon[29535]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-05T07:45:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:04 smithi175 ceph-mon[34585]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-05T07:45:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:06 smithi154 ceph-mon[34710]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:06.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:06 smithi144 ceph-mon[29535]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:06.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:06.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:06.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:06 smithi175 ceph-mon[34585]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:08.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:08 smithi154 ceph-mon[34710]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:08.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:08 smithi144 ceph-mon[29535]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:08 smithi175 ceph-mon[34585]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.968+0000 7fa2e5ffb640 1 -- 172.21.15.154:0/1318099015 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2e8062630 con 0x7fa2d80a2bb0 2024-09-05T07:45:09.969 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 msgr2=0x7fa2d80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 0x7fa2d80a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00bbe0 tx=0x7fa2dc00b390 comp rx=0 tx=0).stop 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 msgr2=0x7fa2e8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400d770 tx=0x7fa2d400dc30 comp rx=0 tx=0).stop 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 shutdown_connections 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa2d80a2bb0 0x7fa2d80a5070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e8105030 0x7fa2e8198430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8107960 0x7fa2e819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 --2- 172.21.15.154:0/1318099015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e8102700 0x7fa2e8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 >> 172.21.15.154:0/1318099015 conn(0x7fa2e80fc2a0 msgr2=0x7fa2e8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:45:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 shutdown_connections 2024-09-05T07:45:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:45:09.971+0000 7fa2eec9e640 1 -- 172.21.15.154:0/1318099015 wait complete. 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:10.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:10.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:10.598 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.4.service 2024-09-05T07:45:10.600 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-09-05T07:45:10.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T07:45:10.854 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:45:12.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:12 smithi154 ceph-mon[34710]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:12.492 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:12 smithi175 ceph-mon[34585]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:12 smithi144 ceph-mon[29535]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:12.687 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:45:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:45:12.376+0000 7f5787fdf640 -1 osd.4 0 log_to_monitors true 2024-09-05T07:45:13.370 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:13 smithi175 ceph-mon[34585]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.371 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:13 smithi175 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.373 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:45:13.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-09-05T07:45:13.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:13 smithi154 ceph-mon[34710]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:13 smithi154 ceph-mon[34710]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:13 smithi144 ceph-mon[29535]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:13 smithi144 ceph-mon[29535]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T07:45:13.654 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:45:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 -- 172.21.15.175:0/1432228677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 msgr2=0x7f75d8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 --2- 172.21.15.175:0/1432228677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d8108f20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009ca0 tx=0x7f75d002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 -- 172.21.15.175:0/1432228677 shutdown_connections 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 --2- 172.21.15.175:0/1432228677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d8108f20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 --2- 172.21.15.175:0/1432228677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75d8101cd0 0x7f75d8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 --2- 172.21.15.175:0/1432228677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 0x7f75d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 -- 172.21.15.175:0/1432228677 >> 172.21.15.175:0/1432228677 conn(0x7f75d80fc280 msgr2=0x7f75d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 -- 172.21.15.175:0/1432228677 shutdown_connections 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.091+0000 7f75dce5d640 1 -- 172.21.15.175:0/1432228677 wait complete. 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 Processor -- start 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 -- start start 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 0x7f75d8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75d8101cd0 0x7f75d81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f75d810c730 con 0x7f75d8101cd0 2024-09-05T07:45:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f75d810c5b0 con 0x7f75d8100ad0 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75dce5d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75d810c8b0 con 0x7f75d8102690 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75d6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75d6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40556/0 (socket says 172.21.15.175:40556) 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.092+0000 7f75d6d9d640 1 -- 172.21.15.175:0/3023483559 learned_addr learned my addr 172.21.15.175:0/3023483559 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d659c640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 0x7f75d8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 -- 172.21.15.175:0/3023483559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 msgr2=0x7f75d8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 0x7f75d8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 -- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75d8101cd0 msgr2=0x7f75d81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75d8101cd0 0x7f75d81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 -- 172.21.15.175:0/3023483559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d819fad0 con 0x7f75d8102690 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75d6d9d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f75d0005cc0 tx=0x7f75d0009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:45:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0003c30 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d819fd60 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d0003dd0 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d002fc50 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.093+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d81a02c0 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.094+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d81a05b0 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.095+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f75d0004050 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.096+0000 7f75c77fe640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 0x7f75c00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.096+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f75d00ef3b0 con 0x7f75d8102690 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.096+0000 7f75d659c640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 0x7f75c00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.097+0000 7f75d659c640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 0x7f75c00a5070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d8101b30 tx=0x7f75c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:45:14.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.103+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75d00bd4b0 con 0x7f75d8102690 2024-09-05T07:45:14.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:14.285+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f75d81a0780 con 0x7f75c00a2bb0 2024-09-05T07:45:14.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:14.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:14 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:14.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:14.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:14 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.687 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:45:14.262+0000 7f5783f62640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T07:45:14.687 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:45:14.268+0000 7f577fd8a640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:45:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:14.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:14.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:14 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi154 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:15.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:15 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi154 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:15.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:15.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:15.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:15 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi154 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:15.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:15.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:15.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:15.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:15 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:16.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:45:16.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:45:16.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:16.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] boot 2024-09-05T07:45:16.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T07:45:16.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] boot 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T07:45:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: osd.4 [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] boot 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T07:45:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/77426367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]': finished 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/1809814394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/77426367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]': finished 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:17.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/1809814394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T07:45:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/77426367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]: dispatch 2024-09-05T07:45:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeee00a8-ae82-475e-8fc3-c027522f80a3"}]': finished 2024-09-05T07:45:17.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T07:45:17.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:17.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/1809814394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:18.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:18 smithi144 ceph-mon[29535]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:18 smithi175 ceph-mon[34585]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:18.588 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:18 smithi154 ceph-mon[34710]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:20.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:20 smithi144 ceph-mon[29535]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:20 smithi175 ceph-mon[34585]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:20 smithi154 ceph-mon[34710]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:22 smithi144 ceph-mon[29535]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:22 smithi175 ceph-mon[34585]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:22 smithi154 ceph-mon[34710]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:24.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:24 smithi144 ceph-mon[29535]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:24 smithi175 ceph-mon[34585]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:24 smithi154 ceph-mon[34710]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:25.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T07:45:25.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T07:45:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T07:45:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:26.558 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:26 smithi175 ceph-mon[34585]: Deploying daemon osd.5 on smithi175 2024-09-05T07:45:26.558 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:26 smithi175 ceph-mon[34585]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:26 smithi144 ceph-mon[29535]: Deploying daemon osd.5 on smithi175 2024-09-05T07:45:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:26 smithi144 ceph-mon[29535]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:26 smithi154 ceph-mon[34710]: Deploying daemon osd.5 on smithi175 2024-09-05T07:45:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:26 smithi154 ceph-mon[34710]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:28.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:28 smithi175 ceph-mon[34585]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:28.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:28 smithi144 ceph-mon[29535]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:28 smithi154 ceph-mon[34710]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:30.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:30 smithi144 ceph-mon[29535]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:30.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:30 smithi175 ceph-mon[34585]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:30 smithi154 ceph-mon[34710]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:32.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:32 smithi175 ceph-mon[34585]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:32.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:32 smithi144 ceph-mon[29535]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:32 smithi154 ceph-mon[34710]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:34.217 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:34.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:34.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:33 smithi175 ceph-mon[34585]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:34.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.259+0000 7f75c77fe640 1 -- 172.21.15.175:0/3023483559 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f75d81a0780 con 0x7f75c00a2bb0 2024-09-05T07:45:34.261 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.261+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 msgr2=0x7f75c00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.261+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 0x7f75c00a5070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d8101b30 tx=0x7f75c800b390 comp rx=0 tx=0).stop 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.261+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 msgr2=0x7f75d819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.261+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f75d0005cc0 tx=0x7f75d0009890 comp rx=0 tx=0).stop 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 shutdown_connections 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f75c00a2bb0 0x7f75c00a5070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:34.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d8102690 0x7f75d819f460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:34.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75d8101cd0 0x7f75d81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:34.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 --2- 172.21.15.175:0/3023483559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d8100ad0 0x7f75d8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:34.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 >> 172.21.15.175:0/3023483559 conn(0x7f75d80fc280 msgr2=0x7f75d80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:45:34.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 shutdown_connections 2024-09-05T07:45:34.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:45:34.262+0000 7f75dce5d640 1 -- 172.21.15.175:0/3023483559 wait complete. 2024-09-05T07:45:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:33 smithi144 ceph-mon[29535]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:34.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:34.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:33 smithi154 ceph-mon[34710]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:35.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:35.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.140 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.5.service 2024-09-05T07:45:35.143 INFO:tasks.cephadm:Deploying osd.6 on smithi144 with /dev/vg_nvme/lv_2... 2024-09-05T07:45:35.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T07:45:35.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:35.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:35.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:45:36.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:36 smithi175 ceph-mon[34585]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:36.267 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:45:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:45:36.098+0000 7fbef9e67640 -1 osd.5 0 log_to_monitors true 2024-09-05T07:45:36.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:36 smithi144 ceph-mon[29535]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:36 smithi154 ceph-mon[34710]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:37.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:37 smithi175 ceph-mon[34585]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:37.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:37 smithi175 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:37.318 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:37 smithi144 ceph-mon[29535]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:37.318 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:37 smithi144 ceph-mon[29535]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:37.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:37 smithi154 ceph-mon[34710]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:37.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:37 smithi154 ceph-mon[34710]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:38.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:38.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:45:38.022+0000 7fbef5dea640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T07:45:38.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:45:38.029+0000 7fbef1c12640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:38.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T07:45:38.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:45:38.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:45:38.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2024-09-05T07:45:38.912 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:45:39.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi175 2024-09-05T07:45:39.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-05T07:45:39.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:45:39.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T07:45:39.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:39 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi175 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:39 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi175 2024-09-05T07:45:39.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-05T07:45:39.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:45:39.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T07:45:39.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:39 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.458+0000 7fa688800640 1 -- 172.21.15.144:0/4044383768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 msgr2=0x7fa680104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.458+0000 7fa688800640 1 --2- 172.21.15.144:0/4044383768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa680104200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa674009900 tx=0x7fa67402a410 comp rx=0 tx=0).stop 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 -- 172.21.15.144:0/4044383768 shutdown_connections 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 --2- 172.21.15.144:0/4044383768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa6801053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 --2- 172.21.15.144:0/4044383768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 0x7fa68010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 --2- 172.21.15.144:0/4044383768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa680104200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 -- 172.21.15.144:0/4044383768 >> 172.21.15.144:0/4044383768 conn(0x7fa6800ff5b0 msgr2=0x7fa6801019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 -- 172.21.15.144:0/4044383768 shutdown_connections 2024-09-05T07:45:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.459+0000 7fa688800640 1 -- 172.21.15.144:0/4044383768 wait complete. 2024-09-05T07:45:39.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 Processor -- start 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 -- start start 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa68019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 0x7fa6801a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010fb00 con 0x7fa680103e00 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010f980 con 0x7fa680104f60 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa688800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010fc80 con 0x7fa680105920 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa685e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa685400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa68019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.460+0000 7fa685e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49540/0 (socket says 172.21.15.144:49540) 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685e00640 1 -- 172.21.15.144:0/118455071 learned_addr learned my addr 172.21.15.144:0/118455071 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:45:39.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa686800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 0x7fa6801a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 -- 172.21.15.144:0/118455071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 msgr2=0x7fa6801a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 0x7fa6801a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 -- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 msgr2=0x7fa68019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 -- 172.21.15.144:0/118455071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6801a1d00 con 0x7fa680104f60 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685e00640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.461+0000 7fa685400640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa68019a610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e9c0 tx=0x7fa67000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.462+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ccc0 con 0x7fa680104f60 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.462+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6700035f0 con 0x7fa680104f60 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.462+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6801a1ff0 con 0x7fa680104f60 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.462+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ce60 con 0x7fa680104f60 2024-09-05T07:45:39.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.462+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6801a24a0 con 0x7fa680104f60 2024-09-05T07:45:39.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.463+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68010b120 con 0x7fa680104f60 2024-09-05T07:45:39.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.465+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa6700037a0 con 0x7fa680104f60 2024-09-05T07:45:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.466+0000 7fa67aa00640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 0x7fa6680a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:45:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.466+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4562+0+0 (secure 0 0 0) 0x7fa6700ce590 con 0x7fa680104f60 2024-09-05T07:45:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.466+0000 7fa685e00640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 0x7fa6680a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:45:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.467+0000 7fa685e00640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 0x7fa6680a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6740096c0 tx=0x7fa6740315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:45:39.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.471+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa67009c2f0 con 0x7fa680104f60 2024-09-05T07:45:39.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:45:39.653+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa680062630 con 0x7fa6680a2bb0 2024-09-05T07:45:40.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] boot 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:40.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] boot 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:40.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:40.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:40.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: osd.5 [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] boot 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T07:45:40.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-05T07:45:40.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:45:40.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:45:40.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:41.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:41 smithi144 ceph-mon[29535]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:41.383 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:41 smithi144 ceph-mon[29535]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T07:45:41.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:41 smithi154 ceph-mon[34710]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:41.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:41 smithi154 ceph-mon[34710]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T07:45:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:41 smithi175 ceph-mon[34585]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:45:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:41 smithi175 ceph-mon[34585]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T07:45:42.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:42 smithi144 ceph-mon[29535]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T07:45:42.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:42 smithi144 ceph-mon[29535]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:42 smithi175 ceph-mon[34585]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T07:45:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:42 smithi175 ceph-mon[34585]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:42 smithi154 ceph-mon[34710]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T07:45:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:42 smithi154 ceph-mon[34710]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: osdmap e41: 6 total, 6 up, 6 in 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/279062546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]': finished 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T07:45:43.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: osdmap e41: 6 total, 6 up, 6 in 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/279062546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]': finished 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T07:45:43.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:45:43.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: osdmap e41: 6 total, 6 up, 6 in 2024-09-05T07:45:43.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/279062546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]: dispatch 2024-09-05T07:45:43.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7f17d-6323-408a-b7bb-7959f4778f91"}]': finished 2024-09-05T07:45:43.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T07:45:43.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:45:44.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:44 smithi144 ceph-mon[29535]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:44 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3752533575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:44 smithi175 ceph-mon[34585]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:44 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3752533575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:44 smithi154 ceph-mon[34710]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:44 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3752533575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:45:46.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:46 smithi144 ceph-mon[29535]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:45:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:46 smithi175 ceph-mon[34585]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:45:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:46 smithi154 ceph-mon[34710]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-05T07:45:48.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:48 smithi144 ceph-mon[29535]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:45:48.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:48 smithi154 ceph-mon[34710]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:45:48.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:48 smithi175 ceph-mon[34585]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:45:50.367 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:50 smithi144 ceph-mon[29535]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:50.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:50 smithi175 ceph-mon[34585]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:50 smithi154 ceph-mon[34710]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:45:52.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:52 smithi144 ceph-mon[29535]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:45:52.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T07:45:52.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:52 smithi175 ceph-mon[34585]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:45:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T07:45:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:52 smithi154 ceph-mon[34710]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:45:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T07:45:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:45:53.314 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:53 smithi144 ceph-mon[29535]: Deploying daemon osd.6 on smithi144 2024-09-05T07:45:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:53 smithi175 ceph-mon[34585]: Deploying daemon osd.6 on smithi144 2024-09-05T07:45:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:53 smithi154 ceph-mon[34710]: Deploying daemon osd.6 on smithi144 2024-09-05T07:45:54.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:54 smithi144 ceph-mon[29535]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T07:45:54.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:54 smithi175 ceph-mon[34585]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T07:45:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:54 smithi154 ceph-mon[34710]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-05T07:45:56.487 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:56 smithi144 ceph-mon[29535]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:56 smithi175 ceph-mon[34585]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:56 smithi154 ceph-mon[34710]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:45:58.279 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:58 smithi144 ceph-mon[29535]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:58.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:58 smithi175 ceph-mon[34585]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:58 smithi154 ceph-mon[34710]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:45:59.449 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:59.449 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:59.449 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:45:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:59.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:59.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:59.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:45:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:45:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:45:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:45:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:00.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:00 smithi144 ceph-mon[29535]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:00.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:00 smithi175 ceph-mon[34585]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:00 smithi154 ceph-mon[34710]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:02.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:02.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:02.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:02.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:02.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:02.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.759+0000 7fa67aa00640 1 -- 172.21.15.144:0/118455071 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa680062630 con 0x7fa6680a2bb0 2024-09-05T07:46:02.761 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 6 on host 'smithi144' 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 msgr2=0x7fa6680a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 0x7fa6680a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6740096c0 tx=0x7fa6740315b0 comp rx=0 tx=0).stop 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 msgr2=0x7fa68019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa68019a610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e9c0 tx=0x7fa67000ee80 comp rx=0 tx=0).stop 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 shutdown_connections 2024-09-05T07:46:02.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa6680a2bb0 0x7fa6680a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa680104f60 0x7fa68019a610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa680105920 0x7fa6801a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 --2- 172.21.15.144:0/118455071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa680103e00 0x7fa68019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 >> 172.21.15.144:0/118455071 conn(0x7fa6800ff5b0 msgr2=0x7fa6801082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 shutdown_connections 2024-09-05T07:46:02.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:02.762+0000 7fa688800640 1 -- 172.21.15.144:0/118455071 wait complete. 2024-09-05T07:46:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:03.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.652 DEBUG:teuthology.orchestra.run.smithi144:osd.6> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.6.service 2024-09-05T07:46:03.656 INFO:tasks.cephadm:Deploying osd.7 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-05T07:46:03.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T07:46:03.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:03.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:03.910 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:46:04.328 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:04 smithi154 ceph-mon[34710]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:04.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:04 smithi144 ceph-mon[29535]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:04 smithi175 ceph-mon[34585]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:04.866 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:46:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:46:04.683+0000 7f9dd1f61640 -1 osd.6 0 log_to_monitors true 2024-09-05T07:46:05.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:05 smithi154 ceph-mon[34710]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T07:46:05.455 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:05 smithi144 ceph-mon[29535]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T07:46:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:05 smithi175 ceph-mon[34585]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T07:46:06.523 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-mon[29535]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:06.523 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-mon[29535]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T07:46:06.523 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-mon[29535]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T07:46:06.523 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-mon[29535]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:46:06.524 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:06.566 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:06 smithi154 ceph-mon[34710]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:06.566 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:06 smithi154 ceph-mon[34710]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T07:46:06.566 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:06 smithi154 ceph-mon[34710]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T07:46:06.566 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:06 smithi154 ceph-mon[34710]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:46:06.566 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:06.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:46:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:06 smithi175 ceph-mon[34585]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:06 smithi175 ceph-mon[34585]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T07:46:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:06 smithi175 ceph-mon[34585]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T07:46:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:06 smithi175 ceph-mon[34585]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:46:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:06.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-05T07:46:06.888 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:46:07.071 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:46:06.811+0000 7f9dcce00640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T07:46:07.071 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:46:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:46:06.838+0000 7f9dc2e00640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- 172.21.15.154:0/1732974508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c102690 msgr2=0x7f2c9c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 --2- 172.21.15.154:0/1732974508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c102690 0x7f2c9c108f20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009900 tx=0x7f2c9402a410 comp rx=0 tx=0).stop 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- 172.21.15.154:0/1732974508 shutdown_connections 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 --2- 172.21.15.154:0/1732974508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c102690 0x7f2c9c108f20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 --2- 172.21.15.154:0/1732974508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 --2- 172.21.15.154:0/1732974508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- 172.21.15.154:0/1732974508 >> 172.21.15.154:0/1732974508 conn(0x7f2c9c0fc280 msgr2=0x7f2c9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- 172.21.15.154:0/1732974508 shutdown_connections 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- 172.21.15.154:0/1732974508 wait complete. 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 Processor -- start 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.388+0000 7f2ca329d640 1 -- start start 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c102690 0x7f2c9c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10c750 con 0x7f2c9c100ad0 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10c5d0 con 0x7f2c9c101cd0 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10c8d0 con 0x7f2c9c102690 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41930/0 (socket says 172.21.15.154:41930) 2024-09-05T07:46:07.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 -- 172.21.15.154:0/2017533525 learned_addr learned my addr 172.21.15.154:0/2017533525 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca1039640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca183a640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c102690 0x7f2c9c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 -- 172.21.15.154:0/2017533525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c102690 msgr2=0x7f2c9c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c102690 0x7f2c9c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 -- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 msgr2=0x7f2c9c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 -- 172.21.15.154:0/2017533525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c19fa80 con 0x7f2c9c101cd0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca1039640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca0838640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c920 tx=0x7f2c9000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90007c70 con 0x7f2c9c101cd0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c90007e10 con 0x7f2c9c101cd0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c19fd70 con 0x7f2c9c101cd0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.389+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90018890 con 0x7f2c9c101cd0 2024-09-05T07:46:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.390+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c1a0250 con 0x7f2c9c101cd0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.390+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c1a04e0 con 0x7f2c9c101cd0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.392+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2c90018ad0 con 0x7f2c9c101cd0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.392+0000 7f2c9a7fc640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 0x7f2c840a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.392+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f2c900ce660 con 0x7f2c9c101cd0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.392+0000 7f2ca1039640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 0x7f2c840a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.393+0000 7f2ca1039640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 0x7f2c840a5070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c101b30 tx=0x7f2c8c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.399+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c90014030 con 0x7f2c9c101cd0 2024-09-05T07:46:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:07 smithi154 ceph-mon[34710]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:46:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:07 smithi154 ceph-mon[34710]: osdmap e44: 7 total, 6 up, 7 in 2024-09-05T07:46:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:07 smithi154 ceph-mon[34710]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' 2024-09-05T07:46:07.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:07 smithi144 ceph-mon[29535]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:46:07.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:07 smithi144 ceph-mon[29535]: osdmap e44: 7 total, 6 up, 7 in 2024-09-05T07:46:07.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:07 smithi144 ceph-mon[29535]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' 2024-09-05T07:46:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:07.582+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2c9c1a06b0 con 0x7f2c840a2bb0 2024-09-05T07:46:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:07 smithi175 ceph-mon[34585]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:46:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:07 smithi175 ceph-mon[34585]: osdmap e44: 7 total, 6 up, 7 in 2024-09-05T07:46:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:07 smithi175 ceph-mon[34585]: from='osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943]' entity='osd.6' 2024-09-05T07:46:08.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:46:08.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi144 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:08.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:08.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] boot 2024-09-05T07:46:08.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T07:46:08.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi144 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:08.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.574 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] boot 2024-09-05T07:46:08.574 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T07:46:08.574 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:46:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:46:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-05T07:46:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi144 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:08.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:08.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: osd.6 [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] boot 2024-09-05T07:46:08.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T07:46:08.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T07:46:09.362 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:09 smithi154 ceph-mon[34710]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:09.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:09 smithi144 ceph-mon[29535]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:09.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:09 smithi175 ceph-mon[34585]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: osdmap e46: 7 total, 7 up, 7 in 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/2468700833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]': finished 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T07:46:10.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: osdmap e46: 7 total, 7 up, 7 in 2024-09-05T07:46:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/2468700833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]': finished 2024-09-05T07:46:10.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T07:46:10.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: osdmap e46: 7 total, 7 up, 7 in 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/2468700833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]: dispatch 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2"}]': finished 2024-09-05T07:46:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T07:46:10.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:11.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:11 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/1545779115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:11.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:11 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/1545779115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:11 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/1545779115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:12 smithi144 ceph-mon[29535]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:12.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:12 smithi175 ceph-mon[34585]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:12 smithi154 ceph-mon[34710]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:14.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:14 smithi144 ceph-mon[29535]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:14.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:14 smithi175 ceph-mon[34585]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:14 smithi154 ceph-mon[34710]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:16.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:16 smithi144 ceph-mon[29535]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:16.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:16 smithi175 ceph-mon[34585]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:16.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:16 smithi154 ceph-mon[34710]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:18.546 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:18 smithi144 ceph-mon[29535]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:18 smithi175 ceph-mon[34585]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:18.666 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:18 smithi154 ceph-mon[34710]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:19.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:19 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T07:46:19.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:19 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:19.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T07:46:19.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:19 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:19.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:19 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T07:46:19.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:19 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:20.401 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:20 smithi154 ceph-mon[34710]: Deploying daemon osd.7 on smithi154 2024-09-05T07:46:20.401 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:20 smithi154 ceph-mon[34710]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:20.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:20 smithi144 ceph-mon[29535]: Deploying daemon osd.7 on smithi154 2024-09-05T07:46:20.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:20 smithi144 ceph-mon[29535]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:20 smithi175 ceph-mon[34585]: Deploying daemon osd.7 on smithi154 2024-09-05T07:46:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:20 smithi175 ceph-mon[34585]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:22.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:22 smithi154 ceph-mon[34710]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:22 smithi144 ceph-mon[29535]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:22 smithi175 ceph-mon[34585]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:24 smithi144 ceph-mon[29535]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:24.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:24.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:24 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:24 smithi175 ceph-mon[34585]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:24 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:24.677 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:24 smithi154 ceph-mon[34710]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:24.677 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:24.677 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:24.677 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:24 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:26 smithi144 ceph-mon[29535]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:26.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:26 smithi175 ceph-mon[34585]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:26.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:26 smithi154 ceph-mon[34710]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:28.012 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 7 on host 'smithi154' 2024-09-05T07:46:28.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.012+0000 7f2c9a7fc640 1 -- 172.21.15.154:0/2017533525 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2c9c1a06b0 con 0x7f2c840a2bb0 2024-09-05T07:46:28.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 msgr2=0x7f2c840a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 0x7f2c840a5070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c101b30 tx=0x7f2c8c009520 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 msgr2=0x7f2c9c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c920 tx=0x7f2c9000cde0 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 shutdown_connections 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2c840a2bb0 0x7f2c840a5070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c9c101cd0 0x7f2c9c198400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c9c102690 0x7f2c9c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 --2- 172.21.15.154:0/2017533525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c9c100ad0 0x7f2c9c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 >> 172.21.15.154:0/2017533525 conn(0x7f2c9c0fc280 msgr2=0x7f2c9c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 shutdown_connections 2024-09-05T07:46:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:46:28.014+0000 7f2ca329d640 1 -- 172.21.15.154:0/2017533525 wait complete. 2024-09-05T07:46:28.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:28.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:28.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:27 smithi144 ceph-mon[29535]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:27 smithi175 ceph-mon[34585]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:28.372 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:28.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:27 smithi154 ceph-mon[34710]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:28.701 DEBUG:teuthology.orchestra.run.smithi154:osd.7> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.7.service 2024-09-05T07:46:28.703 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-09-05T07:46:28.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T07:46:28.956 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:46:29.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:29.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:29.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:29.325 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:29.325 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:29.325 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:29.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:29.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:29.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:30.169 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:30 smithi154 ceph-mon[34710]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:30.249 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:29 smithi175 ceph-mon[34585]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:30.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:29 smithi144 ceph-mon[29535]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:30.880 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:46:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:46:30.529+0000 7fbc34038640 -1 osd.7 0 log_to_monitors true 2024-09-05T07:46:31.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:31 smithi175 ceph-mon[34585]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:31 smithi175 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.133 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:31 smithi154 ceph-mon[34710]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.149 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:31 smithi154 ceph-mon[34710]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:31 smithi144 ceph-mon[29535]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:31 smithi144 ceph-mon[29535]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T07:46:31.699 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:46:31.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-09-05T07:46:31.996 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:46:32.278 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T07:46:32.278 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:32.279 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:32.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.404 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T07:46:32.404 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T07:46:32.404 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:32.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 -- 172.21.15.175:0/2784903628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 msgr2=0x7efcc4108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 --2- 172.21.15.175:0/2784903628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc4108da0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009ca0 tx=0x7efcbc02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 -- 172.21.15.175:0/2784903628 shutdown_connections 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 --2- 172.21.15.175:0/2784903628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 --2- 172.21.15.175:0/2784903628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc4108da0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 --2- 172.21.15.175:0/2784903628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 -- 172.21.15.175:0/2784903628 >> 172.21.15.175:0/2784903628 conn(0x7efcc40fc0e0 msgr2=0x7efcc40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 -- 172.21.15.175:0/2784903628 shutdown_connections 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.506+0000 7efcca1a2640 1 -- 172.21.15.175:0/2784903628 wait complete. 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 Processor -- start 2024-09-05T07:46:32.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 -- start start 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410c650 con 0x7efcc4100950 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410c4d0 con 0x7efcc4101b50 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcca1a2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410c7d0 con 0x7efcc4102510 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcc99a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcc99a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44978/0 (socket says 172.21.15.175:44978) 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcc99a1640 1 -- 172.21.15.175:0/155079203 learned_addr learned my addr 172.21.15.175:0/155079203 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcc899f640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.507+0000 7efcc91a0640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:32.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 -- 172.21.15.175:0/155079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 msgr2=0x7efcc4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 -- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 msgr2=0x7efcc4197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 -- 172.21.15.175:0/155079203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc419f960 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc899f640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc91a0640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcc99a1640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcbc031ec0 tx=0x7efcbc031ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc003b70 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc419fbf0 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcbc003d10 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004750 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.508+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41a0130 con 0x7efcc4102510 2024-09-05T07:46:32.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.509+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc41a0420 con 0x7efcc4102510 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.510+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7efcbc004b40 con 0x7efcc4102510 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.511+0000 7efcba7fc640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 0x7efcb00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.511+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7efcbc0ef8a0 con 0x7efcc4102510 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.511+0000 7efcc91a0640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 0x7efcb00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.512+0000 7efcc91a0640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 0x7efcb00a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcc41019b0 tx=0x7efcc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:32.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.514+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcbc0bd480 con 0x7efcc4102510 2024-09-05T07:46:32.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:46:32.403+0000 7fbc2ffbb640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T07:46:32.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:46:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:46:32.415+0000 7fbc27ddb640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:46:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:32.690+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7efcc41a05f0 con 0x7efcb00a2bb0 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi154 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: osdmap e49: 8 total, 7 up, 8 in 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='osd.7 ' entity='osd.7' 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:33.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] boot 2024-09-05T07:46:33.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T07:46:33.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi154 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: osdmap e49: 8 total, 7 up, 8 in 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='osd.7 ' entity='osd.7' 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] boot 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T07:46:33.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi154 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: osdmap e49: 8 total, 7 up, 8 in 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='osd.7 ' entity='osd.7' 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: osd.7 [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] boot 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T07:46:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T07:46:34.216 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:34 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:46:34.216 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:34 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:46:34.216 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:34 smithi175 ceph-mon[34585]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:34.216 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:34 smithi175 ceph-mon[34585]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:34.216 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:34 smithi175 ceph-mon[34585]: osdmap e51: 8 total, 8 up, 8 in 2024-09-05T07:46:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:34 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:46:34.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:34 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:46:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:34 smithi144 ceph-mon[29535]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:34 smithi144 ceph-mon[29535]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:34.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:34 smithi144 ceph-mon[29535]: osdmap e51: 8 total, 8 up, 8 in 2024-09-05T07:46:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:34 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:46:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:34 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:46:34.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:34 smithi154 ceph-mon[34710]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:46:34.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:34 smithi154 ceph-mon[34710]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:34.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:34 smithi154 ceph-mon[34710]: osdmap e51: 8 total, 8 up, 8 in 2024-09-05T07:46:36.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: osdmap e52: 8 total, 8 up, 8 in 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: pgmap v177: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/4167950846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]': finished 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:36.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:36 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2175461040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:36.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: osdmap e52: 8 total, 8 up, 8 in 2024-09-05T07:46:36.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: pgmap v177: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:36.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/4167950846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]': finished 2024-09-05T07:46:36.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T07:46:36.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:36.324 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:36 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2175461040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: osdmap e52: 8 total, 8 up, 8 in 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: pgmap v177: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/4167950846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]: dispatch 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf5ed3c6-80ad-4e8f-a862-c844a1bc749f"}]': finished 2024-09-05T07:46:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T07:46:36.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:36.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:36 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/2175461040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:46:37.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:37 smithi144 ceph-mon[29535]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T07:46:37.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:37 smithi144 ceph-mon[29535]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T07:46:37.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:37 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:37.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:37 smithi175 ceph-mon[34585]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T07:46:37.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:37 smithi175 ceph-mon[34585]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T07:46:37.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:37 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:37.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:37 smithi154 ceph-mon[34710]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-05T07:46:37.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:37 smithi154 ceph-mon[34710]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T07:46:37.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:37 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:38.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:38 smithi144 ceph-mon[29535]: pgmap v180: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:38.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:38 smithi175 ceph-mon[34585]: pgmap v180: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:38.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:38 smithi154 ceph-mon[34710]: pgmap v180: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-05T07:46:39.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:39 smithi144 ceph-mon[29535]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T07:46:39.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:39 smithi144 ceph-mon[29535]: Cluster is now healthy 2024-09-05T07:46:39.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:39 smithi175 ceph-mon[34585]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T07:46:39.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:39 smithi175 ceph-mon[34585]: Cluster is now healthy 2024-09-05T07:46:39.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:39 smithi154 ceph-mon[34710]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-05T07:46:39.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:39 smithi154 ceph-mon[34710]: Cluster is now healthy 2024-09-05T07:46:40.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:40 smithi144 ceph-mon[29535]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:40 smithi175 ceph-mon[34585]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:40 smithi154 ceph-mon[34710]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:42.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:42 smithi175 ceph-mon[34585]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:42.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:42 smithi144 ceph-mon[29535]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:42 smithi154 ceph-mon[34710]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:44.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:44 smithi175 ceph-mon[34585]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:44.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T07:46:44.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:44 smithi154 ceph-mon[34710]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T07:46:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:44.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:44 smithi144 ceph-mon[29535]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:44.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T07:46:44.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:45.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:45 smithi175 ceph-mon[34585]: Deploying daemon osd.8 on smithi175 2024-09-05T07:46:45.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:45 smithi154 ceph-mon[34710]: Deploying daemon osd.8 on smithi175 2024-09-05T07:46:45.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:45 smithi144 ceph-mon[29535]: Deploying daemon osd.8 on smithi175 2024-09-05T07:46:46.445 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:46 smithi175 ceph-mon[34585]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:46 smithi154 ceph-mon[34710]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:46.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:46 smithi144 ceph-mon[29535]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:48.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:48 smithi175 ceph-mon[34585]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:48 smithi154 ceph-mon[34710]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:48 smithi144 ceph-mon[29535]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:49.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:49.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:49.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:49.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:49.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:49.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:49.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:50.656 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:50 smithi175 ceph-mon[34585]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:50 smithi154 ceph-mon[34710]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:50 smithi144 ceph-mon[29535]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:52.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.002+0000 7efcba7fc640 1 -- 172.21.15.175:0/155079203 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efcc41a05f0 con 0x7efcb00a2bb0 2024-09-05T07:46:53.003 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-09-05T07:46:53.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 msgr2=0x7efcb00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:53.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 0x7efcb00a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcc41019b0 tx=0x7efcc0008040 comp rx=0 tx=0).stop 2024-09-05T07:46:53.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 msgr2=0x7efcc419f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:53.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcbc031ec0 tx=0x7efcbc031ef0 comp rx=0 tx=0).stop 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 shutdown_connections 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcb00a2bb0 0x7efcb00a5070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc4101b50 0x7efcc4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc4102510 0x7efcc419f2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 --2- 172.21.15.175:0/155079203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc4100950 0x7efcc4197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 >> 172.21.15.175:0/155079203 conn(0x7efcc40fc0e0 msgr2=0x7efcc40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 shutdown_connections 2024-09-05T07:46:53.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:46:53.005+0000 7efcca1a2640 1 -- 172.21.15.175:0/155079203 wait complete. 2024-09-05T07:46:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:53 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:53 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:53 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.652 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.8.service 2024-09-05T07:46:53.655 INFO:tasks.cephadm:Deploying osd.9 on smithi144 with /dev/vg_nvme/lv_1... 2024-09-05T07:46:53.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T07:46:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:53 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:53 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:53 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.709 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:53 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:46:53.710 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:53 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:53.710 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:53 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:46:54.486 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:54 smithi144 ceph-mon[29535]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:54 smithi154 ceph-mon[34710]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:54.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:54 smithi175 ceph-mon[34585]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:55.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:55 smithi175 ceph-mon[34585]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:55.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:55 smithi175 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:55.588 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:46:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:46:55.303+0000 7f3e4a865640 -1 osd.8 0 log_to_monitors true 2024-09-05T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:55 smithi144 ceph-mon[29535]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:55.656 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:55 smithi144 ceph-mon[29535]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:55.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:55 smithi154 ceph-mon[34710]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:55.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:55 smithi154 ceph-mon[34710]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:56.658 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:56 smithi144 ceph-mon[29535]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T07:46:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T07:46:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: from='osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:56.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:56 smithi154 ceph-mon[34710]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:46:57.087 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:46:56.751+0000 7f3e467e8640 -1 osd.8 0 waiting for initial osdmap 2024-09-05T07:46:57.088 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:46:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:46:56.762+0000 7f3e3e608640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:46:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:46:57.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2024-09-05T07:46:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:46:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: osdmap e56: 9 total, 8 up, 9 in 2024-09-05T07:46:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:57 smithi154 ceph-mon[34710]: from='osd.8 ' entity='osd.8' 2024-09-05T07:46:57.760 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:46:57.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: osdmap e56: 9 total, 8 up, 9 in 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:57 smithi144 ceph-mon[29535]: from='osd.8 ' entity='osd.8' 2024-09-05T07:46:57.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:46:57.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: osdmap e56: 9 total, 8 up, 9 in 2024-09-05T07:46:57.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:46:57.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:57 smithi175 ceph-mon[34585]: from='osd.8 ' entity='osd.8' 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 -- 172.21.15.144:0/1713828209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400101c00 msgr2=0x7fb400102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 --2- 172.21.15.144:0/1713828209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400101c00 0x7fb400102000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009900 tx=0x7fb3f402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 -- 172.21.15.144:0/1713828209 shutdown_connections 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 --2- 172.21.15.144:0/1713828209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4001037c0 0x7fb40010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 --2- 172.21.15.144:0/1713828209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb400102e00 0x7fb400103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 --2- 172.21.15.144:0/1713828209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400101c00 0x7fb400102000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 -- 172.21.15.144:0/1713828209 >> 172.21.15.144:0/1713828209 conn(0x7fb4000fd390 msgr2=0x7fb4000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 -- 172.21.15.144:0/1713828209 shutdown_connections 2024-09-05T07:46:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.333+0000 7fb408000640 1 -- 172.21.15.144:0/1713828209 wait complete. 2024-09-05T07:46:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 Processor -- start 2024-09-05T07:46:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 -- start start 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4001037c0 0x7fb40019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb40010d8d0 con 0x7fb400102e00 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb40010d750 con 0x7fb400101c00 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb408000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb40010da50 con 0x7fb4001037c0 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.334+0000 7fb404c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb405600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45508/0 (socket says 172.21.15.144:45508) 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 -- 172.21.15.144:0/1678399737 learned_addr learned my addr 172.21.15.144:0/1678399737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:46:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb405600640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39422/0 (socket says 172.21.15.144:39422) 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb406000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4001037c0 0x7fb40019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 -- 172.21.15.144:0/1678399737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4001037c0 msgr2=0x7fb40019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4001037c0 0x7fb40019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 -- 172.21.15.144:0/1678399737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 msgr2=0x7fb400197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 -- 172.21.15.144:0/1678399737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40019fb90 con 0x7fb400102e00 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb405600640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.335+0000 7fb404c00640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00e9f0 tx=0x7fb3ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.336+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00ccc0 con 0x7fb400102e00 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.336+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3ec00ce60 con 0x7fb400102e00 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.336+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40019fe80 con 0x7fb400102e00 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.336+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec010690 con 0x7fb400102e00 2024-09-05T07:46:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.336+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4001a0330 con 0x7fb400102e00 2024-09-05T07:46:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.337+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb400109020 con 0x7fb400102e00 2024-09-05T07:46:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.339+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb3ec0046c0 con 0x7fb400102e00 2024-09-05T07:46:58.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.341+0000 7fb3fe000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 0x7fb3e80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:46:58.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.341+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5862+0+0 (secure 0 0 0) 0x7fb3ec0ce9d0 con 0x7fb400102e00 2024-09-05T07:46:58.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.341+0000 7fb405600640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 0x7fb3e80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:46:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.341+0000 7fb405600640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 0x7fb3e80a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3f402a9e0 tx=0x7fb3f40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:46:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.345+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3ec09c2c0 con 0x7fb400102e00 2024-09-05T07:46:58.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:46:58.531+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb400062630 con 0x7fb3e80a2c30 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi175 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] boot 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T07:46:58.533 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:58 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:58.649 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:46:58.649 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:46:58.649 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi175 2024-09-05T07:46:58.649 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-05T07:46:58.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:58.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] boot 2024-09-05T07:46:58.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T07:46:58.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:58 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:46:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi175 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: osd.8 [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] boot 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T07:46:58.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:58 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T07:46:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:59 smithi154 ceph-mon[34710]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T07:46:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:59 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:59.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:46:59 smithi154 ceph-mon[34710]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T07:46:59.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:59 smithi144 ceph-mon[29535]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T07:46:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:59 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:59.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:46:59 smithi144 ceph-mon[29535]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T07:46:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:59 smithi175 ceph-mon[34585]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T07:46:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:46:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:46:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:59 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:46:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:46:59 smithi175 ceph-mon[34585]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T07:47:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:00 smithi144 ceph-mon[29535]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:00.604 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:00 smithi144 ceph-mon[29535]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:00 smithi154 ceph-mon[34710]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:00 smithi154 ceph-mon[34710]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:00 smithi175 ceph-mon[34585]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:00 smithi175 ceph-mon[34585]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:01.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:01 smithi144 ceph-mon[29535]: osdmap e60: 9 total, 9 up, 9 in 2024-09-05T07:47:01.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:01 smithi154 ceph-mon[34710]: osdmap e60: 9 total, 9 up, 9 in 2024-09-05T07:47:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:01 smithi175 ceph-mon[34585]: osdmap e60: 9 total, 9 up, 9 in 2024-09-05T07:47:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: osdmap e61: 9 total, 9 up, 9 in 2024-09-05T07:47:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]: dispatch 2024-09-05T07:47:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]': finished 2024-09-05T07:47:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T07:47:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:02.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:02 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2763939827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: osdmap e61: 9 total, 9 up, 9 in 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]: dispatch 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]': finished 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:02.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:02 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2763939827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: osdmap e61: 9 total, 9 up, 9 in 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]: dispatch 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2535528626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0975ea21-df34-40c4-96a3-80758343a594"}]': finished 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:02 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2763939827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:04 smithi154 ceph-mon[34710]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T07:47:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:04 smithi144 ceph-mon[29535]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T07:47:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:04 smithi175 ceph-mon[34585]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T07:47:06.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:06 smithi144 ceph-mon[29535]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T07:47:06.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:06 smithi154 ceph-mon[34710]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T07:47:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:06 smithi175 ceph-mon[34585]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-05T07:47:08.475 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:08 smithi144 ceph-mon[29535]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T07:47:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:08 smithi154 ceph-mon[34710]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T07:47:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:08 smithi175 ceph-mon[34585]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T07:47:10.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:10 smithi154 ceph-mon[34710]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:47:10.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:10 smithi144 ceph-mon[29535]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:47:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:10 smithi175 ceph-mon[34585]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T07:47:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T07:47:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:11.790 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T07:47:11.790 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T07:47:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:12 smithi154 ceph-mon[34710]: Deploying daemon osd.9 on smithi144 2024-09-05T07:47:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:12 smithi154 ceph-mon[34710]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-05T07:47:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:12 smithi144 ceph-mon[29535]: Deploying daemon osd.9 on smithi144 2024-09-05T07:47:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:12 smithi144 ceph-mon[29535]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-05T07:47:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:12 smithi175 ceph-mon[34585]: Deploying daemon osd.9 on smithi144 2024-09-05T07:47:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:12 smithi175 ceph-mon[34585]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-05T07:47:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:14 smithi154 ceph-mon[34710]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-05T07:47:14.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:14 smithi144 ceph-mon[29535]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-05T07:47:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:14 smithi175 ceph-mon[34585]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-05T07:47:16.652 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:16 smithi144 ceph-mon[29535]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:16 smithi154 ceph-mon[34710]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:16 smithi175 ceph-mon[34585]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:18 smithi154 ceph-mon[34710]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:18 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:18 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:18 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:18.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:18 smithi144 ceph-mon[29535]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:18.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:18 smithi175 ceph-mon[34585]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:18 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:18 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:18 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:20.496 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:20 smithi144 ceph-mon[29535]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:20 smithi154 ceph-mon[34710]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:20 smithi175 ceph-mon[34585]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.030+0000 7fb3fe000640 1 -- 172.21.15.144:0/1678399737 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb400062630 con 0x7fb3e80a2c30 2024-09-05T07:47:22.032 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 9 on host 'smithi144' 2024-09-05T07:47:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.032+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 msgr2=0x7fb3e80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.032+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 0x7fb3e80a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3f402a9e0 tx=0x7fb3f40315b0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.032+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 msgr2=0x7fb4001984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.032+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00e9f0 tx=0x7fb3ec00edf0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.032+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 shutdown_connections 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb3e80a2c30 0x7fb3e80a50f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4001037c0 0x7fb40019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb400102e00 0x7fb4001984a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 --2- 172.21.15.144:0/1678399737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb400101c00 0x7fb400197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 >> 172.21.15.144:0/1678399737 conn(0x7fb4000fd390 msgr2=0x7fb4001061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 shutdown_connections 2024-09-05T07:47:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:47:22.033+0000 7fb408000640 1 -- 172.21.15.144:0/1678399737 wait complete. 2024-09-05T07:47:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:22 smithi154 ceph-mon[34710]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:22 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:22 smithi144 ceph-mon[29535]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:22 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:22 smithi175 ceph-mon[34585]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:22 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:22.884 DEBUG:teuthology.orchestra.run.smithi144:osd.9> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.9.service 2024-09-05T07:47:22.889 INFO:tasks.cephadm:Deploying osd.10 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-05T07:47:22.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T07:47:23.147 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:47:23.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:23 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:23.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:23 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:23.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:23 smithi144 ceph-mon[29535]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:23.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:23 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:23.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:23 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:23.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:23 smithi154 ceph-mon[34710]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:24.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:23 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:24.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:23 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:24.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:23 smithi175 ceph-mon[34585]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:24.570 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:47:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:47:24.316+0000 7f7746e4a640 -1 osd.9 0 log_to_monitors true 2024-09-05T07:47:24.726 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:24 smithi154 ceph-mon[34710]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T07:47:24.762 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:24 smithi144 ceph-mon[29535]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T07:47:25.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:24 smithi175 ceph-mon[34585]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T07:47:25.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:25 smithi154 ceph-mon[34710]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T07:47:25.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:25 smithi154 ceph-mon[34710]: osdmap e63: 10 total, 9 up, 10 in 2024-09-05T07:47:25.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:25 smithi154 ceph-mon[34710]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:47:25.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:25 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:25.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:25 smithi154 ceph-mon[34710]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-05T07:47:25.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-05T07:47:26.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-mon[29535]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T07:47:26.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-mon[29535]: osdmap e63: 10 total, 9 up, 10 in 2024-09-05T07:47:26.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-mon[29535]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:47:26.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:26.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-mon[29535]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:26.073 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:47:25.647+0000 7f7741600640 -1 osd.9 0 waiting for initial osdmap 2024-09-05T07:47:26.073 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:47:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:47:25.663+0000 7f773c600640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:47:26.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:25 smithi175 ceph-mon[34585]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T07:47:26.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:25 smithi175 ceph-mon[34585]: osdmap e63: 10 total, 9 up, 10 in 2024-09-05T07:47:26.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:25 smithi175 ceph-mon[34585]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-05T07:47:26.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:25 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:26.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:25 smithi175 ceph-mon[34585]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-05T07:47:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 -- 172.21.15.154:0/4275942300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600100b10 msgr2=0x7fc600100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 --2- 172.21.15.154:0/4275942300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600100b10 0x7fc600100f10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009900 tx=0x7fc5f002a410 comp rx=0 tx=0).stop 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 -- 172.21.15.154:0/4275942300 shutdown_connections 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 --2- 172.21.15.154:0/4275942300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6001026d0 0x7fc600108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 --2- 172.21.15.154:0/4275942300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 0x7fc600102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 --2- 172.21.15.154:0/4275942300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600100b10 0x7fc600100f10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.713+0000 7fc60576f640 1 -- 172.21.15.154:0/4275942300 >> 172.21.15.154:0/4275942300 conn(0x7fc6000fc2a0 msgr2=0x7fc6000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- 172.21.15.154:0/4275942300 shutdown_connections 2024-09-05T07:47:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- 172.21.15.154:0/4275942300 wait complete. 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 Processor -- start 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- start start 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 0x7fc60006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 0x7fc60019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010c780 con 0x7fc600100b10 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010c600 con 0x7fc6001026d0 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.714+0000 7fc60576f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010c900 con 0x7fc600101d10 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54714/0 (socket says 172.21.15.154:54714) 2024-09-05T07:47:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 -- 172.21.15.154:0/2125223209 learned_addr learned my addr 172.21.15.154:0/2125223209 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5feffd640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 0x7fc60006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5f67fc640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 0x7fc60019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 -- 172.21.15.154:0/2125223209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 msgr2=0x7fc60019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 0x7fc60019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 -- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 msgr2=0x7fc60006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 0x7fc60006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 -- 172.21.15.154:0/2125223209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60019fbd0 con 0x7fc6001026d0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5feffd640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 0x7fc60006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5ff7fe640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800eaa0 tx=0x7fc5f800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800cdb0 con 0x7fc6001026d0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5f8005020 con 0x7fc6001026d0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60019fe60 con 0x7fc6001026d0 2024-09-05T07:47:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80116b0 con 0x7fc6001026d0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.715+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001a0320 con 0x7fc6001026d0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.716+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc600108020 con 0x7fc6001026d0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.717+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc5f8005560 con 0x7fc6001026d0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.718+0000 7fc5fcff9640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 0x7fc5ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.718+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6261+0+0 (secure 0 0 0) 0x7fc5f80ceea0 con 0x7fc6001026d0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.718+0000 7fc5feffd640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 0x7fc5ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.719+0000 7fc5feffd640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 0x7fc5ec0a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0006010 tx=0x7fc5f0032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:47:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.721+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5f8016030 con 0x7fc6001026d0 2024-09-05T07:47:26.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:26.898+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc600062630 con 0x7fc5ec0a2b80 2024-09-05T07:47:26.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:26 smithi154 ceph-mon[34710]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:47:26.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:26 smithi154 ceph-mon[34710]: osdmap e64: 10 total, 9 up, 10 in 2024-09-05T07:47:26.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:26.899 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:26 smithi144 ceph-mon[29535]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:47:27.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:26 smithi144 ceph-mon[29535]: osdmap e64: 10 total, 9 up, 10 in 2024-09-05T07:47:27.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:26 smithi175 ceph-mon[34585]: from='osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-05T07:47:27.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:26 smithi175 ceph-mon[34585]: osdmap e64: 10 total, 9 up, 10 in 2024-09-05T07:47:27.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:47:27.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:47:27.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] boot 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: osdmap e65: 10 total, 10 up, 10 in 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi144 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:27 smithi144 ceph-mon[29535]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:27.917 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:47:27.917 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] boot 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: osdmap e65: 10 total, 10 up, 10 in 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi144 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-05T07:47:27.918 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.919 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:27 smithi175 ceph-mon[34585]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: osd.9 [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] boot 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: osdmap e65: 10 total, 10 up, 10 in 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi144 2024-09-05T07:47:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:27.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:27.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:27.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:27.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:27 smithi154 ceph-mon[34710]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:29.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:29 smithi154 ceph-mon[34710]: osdmap e66: 10 total, 10 up, 10 in 2024-09-05T07:47:29.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:29 smithi144 ceph-mon[29535]: osdmap e66: 10 total, 10 up, 10 in 2024-09-05T07:47:29.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:29 smithi175 ceph-mon[34585]: osdmap e66: 10 total, 10 up, 10 in 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/1305788324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]': finished 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T07:47:30.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:30.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:30 smithi154 ceph-mon[34710]: from='client.? 172.21.15.154:0/2317975411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:30.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:30.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/1305788324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]': finished 2024-09-05T07:47:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T07:47:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:30.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:30 smithi144 ceph-mon[29535]: from='client.? 172.21.15.154:0/2317975411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/1305788324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]: dispatch 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdcbe9a-a9f5-4ba6-a198-493d6b15d654"}]': finished 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:30.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:30 smithi175 ceph-mon[34585]: from='client.? 172.21.15.154:0/2317975411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:32.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:32 smithi144 ceph-mon[29535]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:32.637 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:32 smithi175 ceph-mon[34585]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:32 smithi154 ceph-mon[34710]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:34.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:34 smithi144 ceph-mon[29535]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:34 smithi175 ceph-mon[34585]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:34 smithi154 ceph-mon[34710]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:36.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:36 smithi154 ceph-mon[34710]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:36.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:36 smithi144 ceph-mon[29535]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:36 smithi175 ceph-mon[34585]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:38.483 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:38 smithi154 ceph-mon[34710]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:38.483 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T07:47:38.483 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:38 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:38.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:38 smithi144 ceph-mon[29535]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:38.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T07:47:38.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:38 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:38 smithi175 ceph-mon[34585]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T07:47:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:38 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:39.567 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:39 smithi154 ceph-mon[34710]: Deploying daemon osd.10 on smithi154 2024-09-05T07:47:39.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:39 smithi144 ceph-mon[29535]: Deploying daemon osd.10 on smithi154 2024-09-05T07:47:39.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:39 smithi175 ceph-mon[34585]: Deploying daemon osd.10 on smithi154 2024-09-05T07:47:40.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:40 smithi154 ceph-mon[34710]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:40.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:40 smithi144 ceph-mon[29535]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:40 smithi175 ceph-mon[34585]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:42.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:42 smithi154 ceph-mon[34710]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:42.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:42 smithi144 ceph-mon[29535]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:42 smithi175 ceph-mon[34585]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:44.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:44 smithi154 ceph-mon[34710]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:44.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:44.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:44.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:44 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:44 smithi144 ceph-mon[29535]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:44.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:44 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:44 smithi175 ceph-mon[34585]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:44.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:44 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:46 smithi154 ceph-mon[34710]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:46.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:46.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:46.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:46 smithi144 ceph-mon[29535]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:46.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:46.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:46 smithi175 ceph-mon[34585]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.103+0000 7fc5fcff9640 1 -- 172.21.15.154:0/2125223209 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc600062630 con 0x7fc5ec0a2b80 2024-09-05T07:47:47.104 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 10 on host 'smithi154' 2024-09-05T07:47:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 msgr2=0x7fc5ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 0x7fc5ec0a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0006010 tx=0x7fc5f0032cf0 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 msgr2=0x7fc60019f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800eaa0 tx=0x7fc5f800ef60 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 shutdown_connections 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc5ec0a2b80 0x7fc5ec0a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6001026d0 0x7fc60019f2c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc600101d10 0x7fc60019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 --2- 172.21.15.154:0/2125223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600100b10 0x7fc60006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 >> 172.21.15.154:0/2125223209 conn(0x7fc6000fc2a0 msgr2=0x7fc6001051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 shutdown_connections 2024-09-05T07:47:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-05T07:47:47.106+0000 7fc60576f640 1 -- 172.21.15.154:0/2125223209 wait complete. 2024-09-05T07:47:47.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:47 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:47 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:47.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:47 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:47 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:47 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:47 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:47.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:47 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:47 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:47 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:47 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:47:47.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:47 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:47.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:47 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:48.014 DEBUG:teuthology.orchestra.run.smithi154:osd.10> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.10.service 2024-09-05T07:47:48.019 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-09-05T07:47:48.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T07:47:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:47:48.580 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:48 smithi144 ceph-mon[29535]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:48.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:48 smithi175 ceph-mon[34585]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:48.696 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:48 smithi154 ceph-mon[34710]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:49.175 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:47:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:47:48.712+0000 7f1fd9783640 -1 osd.10 0 log_to_monitors true 2024-09-05T07:47:49.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:49 smithi154 ceph-mon[34710]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:49.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:49 smithi154 ceph-mon[34710]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:49.564 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:49 smithi175 ceph-mon[34585]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:49.565 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:49 smithi175 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:49.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:49 smithi144 ceph-mon[29535]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:49.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:49 smithi144 ceph-mon[29535]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: osdmap e68: 11 total, 10 up, 11 in 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:50.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:50 smithi175 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:50.687 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:47:50.340+0000 7f1fd5706640 -1 osd.10 0 waiting for initial osdmap 2024-09-05T07:47:50.687 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:47:50.355+0000 7f1fd152e640 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: osdmap e68: 11 total, 10 up, 11 in 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:50.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:50 smithi154 ceph-mon[34710]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T07:47:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: from='osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: osdmap e68: 11 total, 10 up, 11 in 2024-09-05T07:47:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:50.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:50 smithi144 ceph-mon[29535]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-05T07:47:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-05T07:47:51.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-09-05T07:47:51.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:47:51.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: osdmap e69: 11 total, 10 up, 11 in 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:51.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.486 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:47:51.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:47:51.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: osdmap e69: 11 total, 10 up, 11 in 2024-09-05T07:47:51.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: osdmap e69: 11 total, 10 up, 11 in 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:51.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:47:51.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:47:52.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- 172.21.15.175:0/4090024148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670100350 msgr2=0x7f367010a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:52.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 --2- 172.21.15.175:0/4090024148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670100350 0x7f367010a200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3668009ca0 tx=0x7f366802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- 172.21.15.175:0/4090024148 shutdown_connections 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 --2- 172.21.15.175:0/4090024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103be0 0x7f36700ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 --2- 172.21.15.175:0/4090024148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670100350 0x7f367010a200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 --2- 172.21.15.175:0/4090024148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670103210 0x7f3670103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- 172.21.15.175:0/4090024148 >> 172.21.15.175:0/4090024148 conn(0x7f36700fba40 msgr2=0x7f36700fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- 172.21.15.175:0/4090024148 shutdown_connections 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- 172.21.15.175:0/4090024148 wait complete. 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 Processor -- start 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.987+0000 7f36786f4640 1 -- start start 2024-09-05T07:47:52.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 0x7f3670197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:52.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103210 0x7f3670198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f367010d8d0 con 0x7f3670100350 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f367010d750 con 0x7f3670103210 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f367010da50 con 0x7f3670103be0 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42768/0 (socket says 172.21.15.175:42768) 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 -- 172.21.15.175:0/145475695 learned_addr learned my addr 172.21.15.175:0/145475695 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3675c8f640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103210 0x7f3670198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:52.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 -- 172.21.15.175:0/145475695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103210 msgr2=0x7f3670198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676490640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 0x7f3670197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103210 0x7f3670198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 -- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 msgr2=0x7f3670197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 0x7f3670197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 -- 172.21.15.175:0/145475695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367019faf0 con 0x7f3670103be0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676490640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 0x7f3670197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f3676c91640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3668031ee0 tx=0x7f3668031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668003c30 con 0x7f3670103be0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367019fd80 con 0x7f3670103be0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3668003dd0 con 0x7f3670103be0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366802fc10 con 0x7f3670103be0 2024-09-05T07:47:52.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.988+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36701a0240 con 0x7f3670103be0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.990+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670103610 con 0x7f3670103be0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.990+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f36680046c0 con 0x7f3670103be0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.991+0000 7f36677fe640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 0x7f365c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.991+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6727+0+0 (secure 0 0 0) 0x7f36680efd90 con 0x7f3670103be0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.992+0000 7f3676490640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 0x7f365c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.992+0000 7f3676490640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 0x7f365c0a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f367006a490 tx=0x7f366c005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:47:52.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:51.995+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36680bd320 con 0x7f3670103be0 2024-09-05T07:47:52.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:47:52.171+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3670062630 con 0x7f365c0a2bb0 2024-09-05T07:47:52.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:47:52.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi154 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] boot 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: osdmap e70: 11 total, 11 up, 11 in 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:52.581 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:52 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:47:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:47:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi154 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] boot 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: osdmap e70: 11 total, 11 up, 11 in 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:52.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:52 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi154 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: osd.10 [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] boot 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: osdmap e70: 11 total, 11 up, 11 in 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T07:47:52.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:52 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:47:53.545 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:53 smithi175 ceph-mon[34585]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:53.545 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:53 smithi175 ceph-mon[34585]: osdmap e71: 11 total, 11 up, 11 in 2024-09-05T07:47:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:53 smithi154 ceph-mon[34710]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:53 smithi154 ceph-mon[34710]: osdmap e71: 11 total, 11 up, 11 in 2024-09-05T07:47:53.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:53 smithi144 ceph-mon[29535]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:47:53.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:53 smithi144 ceph-mon[29535]: osdmap e71: 11 total, 11 up, 11 in 2024-09-05T07:47:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:54 smithi175 ceph-mon[34585]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:54 smithi175 ceph-mon[34585]: osdmap e72: 11 total, 11 up, 11 in 2024-09-05T07:47:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:54 smithi175 ceph-mon[34585]: osdmap e73: 11 total, 11 up, 11 in 2024-09-05T07:47:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:54 smithi154 ceph-mon[34710]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:54 smithi154 ceph-mon[34710]: osdmap e72: 11 total, 11 up, 11 in 2024-09-05T07:47:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:54 smithi154 ceph-mon[34710]: osdmap e73: 11 total, 11 up, 11 in 2024-09-05T07:47:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:54 smithi144 ceph-mon[29535]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:54 smithi144 ceph-mon[29535]: osdmap e72: 11 total, 11 up, 11 in 2024-09-05T07:47:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:54 smithi144 ceph-mon[29535]: osdmap e73: 11 total, 11 up, 11 in 2024-09-05T07:47:55.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/2068986840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]': finished 2024-09-05T07:47:55.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T07:47:55.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:47:55.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:55 smithi154 ceph-mon[34710]: from='client.? 172.21.15.175:0/3069638955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:55.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/2068986840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]': finished 2024-09-05T07:47:55.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T07:47:55.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:47:55.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:55 smithi144 ceph-mon[29535]: from='client.? 172.21.15.175:0/3069638955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/2068986840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]: dispatch 2024-09-05T07:47:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39af7621-a97a-4c97-8a70-be9bc9772b10"}]': finished 2024-09-05T07:47:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T07:47:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:47:55.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:55 smithi175 ceph-mon[34585]: from='client.? 172.21.15.175:0/3069638955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T07:47:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:56 smithi154 ceph-mon[34710]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:56.723 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:56 smithi144 ceph-mon[29535]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:56 smithi175 ceph-mon[34585]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:47:58 smithi154 ceph-mon[34710]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:47:58 smithi144 ceph-mon[29535]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:47:58.822 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:47:58 smithi175 ceph-mon[34585]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:00.657 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:00 smithi175 ceph-mon[34585]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:48:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:00 smithi154 ceph-mon[34710]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:48:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:00 smithi144 ceph-mon[29535]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T07:48:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:02 smithi154 ceph-mon[34710]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T07:48:02.787 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:02 smithi175 ceph-mon[34585]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T07:48:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:02 smithi144 ceph-mon[29535]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-05T07:48:03.564 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T07:48:03.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:03 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T07:48:03.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:03 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:03.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T07:48:03.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:03 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:04 smithi175 ceph-mon[34585]: Deploying daemon osd.11 on smithi175 2024-09-05T07:48:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:04 smithi175 ceph-mon[34585]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:48:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:04 smithi154 ceph-mon[34710]: Deploying daemon osd.11 on smithi175 2024-09-05T07:48:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:04 smithi154 ceph-mon[34710]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:48:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:04 smithi144 ceph-mon[29535]: Deploying daemon osd.11 on smithi175 2024-09-05T07:48:04.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:04 smithi144 ceph-mon[29535]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-05T07:48:06.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:06 smithi154 ceph-mon[34710]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-05T07:48:06.723 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:06 smithi175 ceph-mon[34585]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-05T07:48:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:06 smithi144 ceph-mon[29535]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-05T07:48:08.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:08 smithi175 ceph-mon[34585]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:08 smithi154 ceph-mon[34710]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:08.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:08 smithi144 ceph-mon[29535]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:09.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:09.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:09.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:09 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:09.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:09.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:09.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:09 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:09.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:09.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:09.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:09 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:10.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:10 smithi175 ceph-mon[34585]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:10.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:10 smithi144 ceph-mon[29535]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:10 smithi154 ceph-mon[34710]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T07:48:12.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.166+0000 7f36677fe640 1 -- 172.21.15.175:0/145475695 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3670062630 con 0x7f365c0a2bb0 2024-09-05T07:48:12.166 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-09-05T07:48:12.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 msgr2=0x7f365c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:12.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 0x7f365c0a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f367006a490 tx=0x7f366c005db0 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 msgr2=0x7f367019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3668031ee0 tx=0x7f3668031f10 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 shutdown_connections 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f365c0a2bb0 0x7f365c0a5070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3670103210 0x7f3670198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3670103be0 0x7f367019f480 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 --2- 172.21.15.175:0/145475695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3670100350 0x7f3670197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 >> 172.21.15.175:0/145475695 conn(0x7f36700fba40 msgr2=0x7f36701062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 shutdown_connections 2024-09-05T07:48:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:12.168+0000 7f36786f4640 1 -- 172.21.15.175:0/145475695 wait complete. 2024-09-05T07:48:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:12.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:12.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:12.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.805 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:12.805 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.805 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.805 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:12.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:12.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:12.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:12.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:12.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:12.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:12.834 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.11.service 2024-09-05T07:48:12.836 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-05T07:48:12.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T07:48:13.209 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 -- 172.21.15.144:0/46138659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440101c00 msgr2=0x7f5440102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 --2- 172.21.15.144:0/46138659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440101c00 0x7f5440102000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5434009900 tx=0x7f543402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 -- 172.21.15.144:0/46138659 shutdown_connections 2024-09-05T07:48:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 --2- 172.21.15.144:0/46138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440102e00 0x7f5440103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 --2- 172.21.15.144:0/46138659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 0x7f544010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 --2- 172.21.15.144:0/46138659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440101c00 0x7f5440102000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 -- 172.21.15.144:0/46138659 >> 172.21.15.144:0/46138659 conn(0x7f54400fd390 msgr2=0x7f54400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 -- 172.21.15.144:0/46138659 shutdown_connections 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.747+0000 7f5448800640 1 -- 172.21.15.144:0/46138659 wait complete. 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 Processor -- start 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 -- start start 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 0x7f54400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 0x7f5440074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f544010d8e0 con 0x7f5440102e00 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f544010d760 con 0x7f5440101c00 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5448800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f544010da60 con 0x7f54401037c0 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5445e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5445400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 0x7f54400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5445e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:56112/0 (socket says 172.21.15.144:56112) 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5445e00640 1 -- 172.21.15.144:0/3695534305 learned_addr learned my addr 172.21.15.144:0/3695534305 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.748+0000 7f5446800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 0x7f5440074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 -- 172.21.15.144:0/3695534305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 msgr2=0x7f5440074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 0x7f5440074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 -- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 msgr2=0x7f54400745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 0x7f54400745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 -- 172.21.15.144:0/3695534305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54400753e0 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445400640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 0x7f54400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5445e00640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5434031440 tx=0x7f5434032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543403f030 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5434003ce0 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434035070 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.749+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54401a2060 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.750+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a24c0 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.751+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440109000 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.752+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5434042030 con 0x7f5440101c00 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.754+0000 7f543aa00640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 0x7f54280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.754+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6809+0+0 (secure 0 0 0) 0x7f54340eeca0 con 0x7f5440101c00 2024-09-05T07:48:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.755+0000 7f5445400640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 0x7f54280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.755+0000 7f5445400640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 0x7f54280a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5440075d10 tx=0x7f5430005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.756+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54340bbaf0 con 0x7f5440101c00 2024-09-05T07:48:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.933+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5440062df0 con 0x7f5440101c00 2024-09-05T07:48:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.934+0000 7f543aa00640 1 -- 172.21.15.144:0/3695534305 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f54340bfdf0 con 0x7f5440101c00 2024-09-05T07:48:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:13.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 msgr2=0x7f54280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 0x7f54280a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5440075d10 tx=0x7f5430005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 msgr2=0x7f5440075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5434031440 tx=0x7f5434032ce0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 shutdown_connections 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f54280a2c00 0x7f54280a50c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54401037c0 0x7f5440074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5440102e00 0x7f54400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 --2- 172.21.15.144:0/3695534305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440101c00 0x7f5440075f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 >> 172.21.15.144:0/3695534305 conn(0x7f54400fd390 msgr2=0x7f54401061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.936+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 shutdown_connections 2024-09-05T07:48:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:13.937+0000 7f5448800640 1 -- 172.21.15.144:0/3695534305 wait complete. 2024-09-05T07:48:14.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:14 smithi144 ceph-mon[29535]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:14.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:14 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3695534305' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:14 smithi154 ceph-mon[34710]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:14 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3695534305' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:14.780 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725522471,"num_in_osds":12,"osd_in_since":1725522474,"num_remapped_pgs":0} 2024-09-05T07:48:14.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:14 smithi175 ceph-mon[34585]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:14.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:14 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3695534305' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:14.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:48:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:48:14.485+0000 7f39e81fc640 -1 osd.11 0 log_to_monitors true 2024-09-05T07:48:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:15 smithi154 ceph-mon[34710]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:15.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:15 smithi154 ceph-mon[34710]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:15.721 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:15 smithi175 ceph-mon[34585]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:15.721 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:15 smithi175 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:15.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T07:48:15.795 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:15 smithi144 ceph-mon[29535]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:15.795 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:15 smithi144 ceph-mon[29535]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T07:48:16.167 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:16.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:16.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T07:48:16.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: osdmap e75: 12 total, 11 up, 12 in 2024-09-05T07:48:16.697 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:16.698 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:16 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 -- 172.21.15.144:0/578412409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c104f60 msgr2=0x7f3b1c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 --2- 172.21.15.144:0/578412409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c104f60 0x7f3b1c1053e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009900 tx=0x7f3b0802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 -- 172.21.15.144:0/578412409 shutdown_connections 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 --2- 172.21.15.144:0/578412409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c105920 0x7f3b1c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 --2- 172.21.15.144:0/578412409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c104f60 0x7f3b1c1053e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 --2- 172.21.15.144:0/578412409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c103e00 0x7f3b1c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 -- 172.21.15.144:0/578412409 >> 172.21.15.144:0/578412409 conn(0x7f3b1c0ff5b0 msgr2=0x7f3b1c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 -- 172.21.15.144:0/578412409 shutdown_connections 2024-09-05T07:48:16.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.702+0000 7f3b23e00640 1 -- 172.21.15.144:0/578412409 wait complete. 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 Processor -- start 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 -- start start 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c103e00 0x7f3b1c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c105920 0x7f3b1c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:16.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c10fab0 con 0x7f3b1c105920 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c10f930 con 0x7f3b1c103e00 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b23e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c10fc30 con 0x7f3b1c104f60 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.703+0000 7f3b20a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:34628/0 (socket says 172.21.15.144:34628) 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 -- 172.21.15.144:0/3640157643 learned_addr learned my addr 172.21.15.144:0/3640157643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b21e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c105920 0x7f3b1c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:16.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b21400640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c103e00 0x7f3b1c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 -- 172.21.15.144:0/3640157643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c103e00 msgr2=0x7f3b1c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c103e00 0x7f3b1c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 -- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c105920 msgr2=0x7f3b1c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c105920 0x7f3b1c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 -- 172.21.15.144:0/3640157643 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c1a1d70 con 0x7f3b1c104f60 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b20a00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b08031610 tx=0x7f3b08004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.704+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0803f030 con 0x7f3b1c104f60 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.705+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b08003ad0 con 0x7f3b1c104f60 2024-09-05T07:48:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.705+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1a2000 con 0x7f3b1c104f60 2024-09-05T07:48:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.705+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08035070 con 0x7f3b1c104f60 2024-09-05T07:48:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.705+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a24e0 con 0x7f3b1c104f60 2024-09-05T07:48:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.706+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c10b240 con 0x7f3b1c104f60 2024-09-05T07:48:16.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.708+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3b08042030 con 0x7f3b1c104f60 2024-09-05T07:48:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.709+0000 7f3b1a000640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 0x7f3b040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.709+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6847+0+0 (secure 0 0 0) 0x7f3b080ef150 con 0x7f3b1c104f60 2024-09-05T07:48:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.709+0000 7f3b21400640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 0x7f3b040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.710+0000 7f3b21400640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 0x7f3b040a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009bd0 tx=0x7f3b10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:16.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.713+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b080bbf80 con 0x7f3b1c104f60 2024-09-05T07:48:16.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:48:16.445+0000 7f39e417f640 -1 osd.11 0 waiting for initial osdmap 2024-09-05T07:48:16.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:48:16.458+0000 7f39dffa7640 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:48:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: osdmap e75: 12 total, 11 up, 12 in 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:16.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:16.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:16 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.896+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3b1c062df0 con 0x7f3b1c104f60 2024-09-05T07:48:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.896+0000 7f3b1a000640 1 -- 172.21.15.144:0/3640157643 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f3b080c0280 con 0x7f3b1c104f60 2024-09-05T07:48:16.897 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 msgr2=0x7f3b040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 0x7f3b040a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009bd0 tx=0x7f3b10005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 msgr2=0x7f3b1c19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b08031610 tx=0x7f3b08004270 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 shutdown_connections 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3b040a2bb0 0x7f3b040a5070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c105920 0x7f3b1c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b1c104f60 0x7f3b1c19a680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3640157643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c103e00 0x7f3b1c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 >> 172.21.15.144:0/3640157643 conn(0x7f3b1c0ff5b0 msgr2=0x7f3b1c108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 shutdown_connections 2024-09-05T07:48:16.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:16.899+0000 7f3b23e00640 1 -- 172.21.15.144:0/3640157643 wait complete. 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: osdmap e75: 12 total, 11 up, 12 in 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-05T07:48:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:16 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:17.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: Detected new or changed devices on smithi175 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: osdmap e76: 12 total, 11 up, 12 in 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3640157643' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:17.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.738 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1725522471,"num_in_osds":12,"osd_in_since":1725522474,"num_remapped_pgs":0} 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: Detected new or changed devices on smithi175 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: osdmap e76: 12 total, 11 up, 12 in 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3640157643' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:17.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: Detected new or changed devices on smithi175 2024-09-05T07:48:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-05T07:48:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-05T07:48:17.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: osdmap e76: 12 total, 11 up, 12 in 2024-09-05T07:48:17.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:17.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3640157643' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:17.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: purged_snaps scrub starts 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: purged_snaps scrub ok 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] boot 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T07:48:18.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:18 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:18.740 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T07:48:18.796 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: purged_snaps scrub starts 2024-09-05T07:48:18.796 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: purged_snaps scrub ok 2024-09-05T07:48:18.796 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:18.797 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] boot 2024-09-05T07:48:18.797 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T07:48:18.797 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:18 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: purged_snaps scrub starts 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: purged_snaps scrub ok 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: osd.11 [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] boot 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T07:48:18.839 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:18 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T07:48:19.113 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:19.539 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:19 smithi144 ceph-mon[29535]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 -- 172.21.15.144:0/2991903733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 msgr2=0x7f2acc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 --2- 172.21.15.144:0/2991903733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc103280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a410 comp rx=0 tx=0).stop 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 -- 172.21.15.144:0/2991903733 shutdown_connections 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 --2- 172.21.15.144:0/2991903733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc1037c0 0x7f2acc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 --2- 172.21.15.144:0/2991903733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc103280 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 --2- 172.21.15.144:0/2991903733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc101c00 0x7f2acc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 -- 172.21.15.144:0/2991903733 >> 172.21.15.144:0/2991903733 conn(0x7f2acc0fd390 msgr2=0x7f2acc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 -- 172.21.15.144:0/2991903733 shutdown_connections 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.648+0000 7f2ad1400640 1 -- 172.21.15.144:0/2991903733 wait complete. 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.649+0000 7f2ad1400640 1 Processor -- start 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.649+0000 7f2ad1400640 1 -- start start 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 0x7f2acc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 0x7f2acc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10d8d0 con 0x7f2acc102e00 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10d750 con 0x7f2acc101c00 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ad1400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10da50 con 0x7f2acc1037c0 2024-09-05T07:48:19.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ac9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 0x7f2acc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ac9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43684/0 (socket says 172.21.15.144:43684) 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2ac9e00640 1 -- 172.21.15.144:0/3899632383 learned_addr learned my addr 172.21.15.144:0/3899632383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2acb200640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 0x7f2acc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 -- 172.21.15.144:0/3899632383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 msgr2=0x7f2acc19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 0x7f2acc19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 -- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 msgr2=0x7f2acc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2aca800640 1 -- 172.21.15.144:0/3899632383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc19fb30 con 0x7f2acc101c00 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.650+0000 7f2acb200640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 0x7f2acc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2aca800640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 0x7f2acc197f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e9c0 tx=0x7f2abc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:19.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ccc0 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc19fe20 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2abc0035f0 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ce60 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.651+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc1a0220 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.652+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc109000 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.654+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2abc0037a0 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.655+0000 7f2ac3400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 0x7f2ab00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.655+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f2abc0cf1e0 con 0x7f2acc101c00 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.655+0000 7f2ac9e00640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 0x7f2ab00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.656+0000 7f2ac9e00640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 0x7f2ab00a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2acc199420 tx=0x7f2ab80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:19.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.659+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2abc09c540 con 0x7f2acc101c00 2024-09-05T07:48:19.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:19 smithi175 ceph-mon[34585]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T07:48:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.841+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2acc062ef0 con 0x7f2acc101c00 2024-09-05T07:48:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.842+0000 7f2ac3400640 1 -- 172.21.15.144:0/3899632383 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) ==== 74+0+133 (secure 0 0 0) 0x7f2abc09be40 con 0x7f2acc101c00 2024-09-05T07:48:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 msgr2=0x7f2ab00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 0x7f2ab00a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2acc199420 tx=0x7f2ab80315b0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 msgr2=0x7f2acc197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 0x7f2acc197f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e9c0 tx=0x7f2abc00ee80 comp rx=0 tx=0).stop 2024-09-05T07:48:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 shutdown_connections 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2ab00a2bb0 0x7f2ab00a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2acc1037c0 0x7f2acc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2acc102e00 0x7f2acc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 --2- 172.21.15.144:0/3899632383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc101c00 0x7f2acc197f00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 >> 172.21.15.144:0/3899632383 conn(0x7f2acc0fd390 msgr2=0x7f2acc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 shutdown_connections 2024-09-05T07:48:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:19.844+0000 7f2ad1400640 1 -- 172.21.15.144:0/3899632383 wait complete. 2024-09-05T07:48:19.852 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:19 smithi154 ceph-mon[34710]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T07:48:20.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:20 smithi144 ceph-mon[29535]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:20.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:20 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3899632383' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:20.664 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1725522497,"num_in_osds":12,"osd_in_since":1725522474,"num_remapped_pgs":0} 2024-09-05T07:48:20.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:48:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:20 smithi175 ceph-mon[34585]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:20 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3899632383' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:20.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:20 smithi154 ceph-mon[34710]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:20.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:20 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3899632383' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T07:48:21.028 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 -- 172.21.15.144:0/1055615813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81079d0 msgr2=0x7fe1b8107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 --2- 172.21.15.144:0/1055615813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81079d0 0x7fe1b8107db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009930 tx=0x7fe1a802a420 comp rx=0 tx=0).stop 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 -- 172.21.15.144:0/1055615813 shutdown_connections 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 --2- 172.21.15.144:0/1055615813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81019d0 0x7fe1b8101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 --2- 172.21.15.144:0/1055615813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 --2- 172.21.15.144:0/1055615813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81079d0 0x7fe1b8107db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 -- 172.21.15.144:0/1055615813 >> 172.21.15.144:0/1055615813 conn(0x7fe1b80fd710 msgr2=0x7fe1b80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 -- 172.21.15.144:0/1055615813 shutdown_connections 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.590+0000 7fe1bda00640 1 -- 172.21.15.144:0/1055615813 wait complete. 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 Processor -- start 2024-09-05T07:48:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 -- start start 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81019d0 0x7fe1b81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 0x7fe1b819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111e20 con 0x7fe1b8102370 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111ca0 con 0x7fe1b81079d0 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.591+0000 7fe1bda00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111fa0 con 0x7fe1b81019d0 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43702/0 (socket says 172.21.15.144:43702) 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 -- 172.21.15.144:0/848420438 learned_addr learned my addr 172.21.15.144:0/848420438 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1bd000640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 0x7fe1b819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1b7e00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81019d0 0x7fe1b81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 -- 172.21.15.144:0/848420438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81019d0 msgr2=0x7fe1b81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81019d0 0x7fe1b81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 -- 172.21.15.144:0/848420438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 msgr2=0x7fe1b819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 0x7fe1b819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 -- 172.21.15.144:0/848420438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b819d290 con 0x7fe1b8102370 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1bd000640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 0x7fe1b819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.592+0000 7fe1afe00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e9f0 tx=0x7fe1a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.593+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000cd80 con 0x7fe1b8102370 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.593+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1a0005500 con 0x7fe1b8102370 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.593+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b819d580 con 0x7fe1b8102370 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.593+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0010690 con 0x7fe1b8102370 2024-09-05T07:48:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.593+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81a4e60 con 0x7fe1b8102370 2024-09-05T07:48:21.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.594+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b8101e30 con 0x7fe1b8102370 2024-09-05T07:48:21.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.596+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe1a00046c0 con 0x7fe1b8102370 2024-09-05T07:48:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.597+0000 7fe1b5600640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 0x7fe19c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.597+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fe1a00cf1a0 con 0x7fe1b8102370 2024-09-05T07:48:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.598+0000 7fe1b7e00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 0x7fe19c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.598+0000 7fe1b7e00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 0x7fe19c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.600+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1a00541b0 con 0x7fe1b8102370 2024-09-05T07:48:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.775+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1b8199640 con 0x7fe1b8102370 2024-09-05T07:48:21.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.777+0000 7fe1b5600640 1 -- 172.21.15.144:0/848420438 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+18559 (secure 0 0 0) 0x7fe1b8199640 con 0x7fe1b8102370 2024-09-05T07:48:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":78,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:48:18.457196+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:48:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.779+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 msgr2=0x7fe19c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.779+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 0x7fe19c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8000bc0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.779+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 msgr2=0x7fe1b8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.779+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e9f0 tx=0x7fe1a000edf0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 shutdown_connections 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe19c0a2c00 0x7fe19c0a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b81079d0 0x7fe1b819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1b8102370 0x7fe1b8198820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 --2- 172.21.15.144:0/848420438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b81019d0 0x7fe1b81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 >> 172.21.15.144:0/848420438 conn(0x7fe1b80fd710 msgr2=0x7fe1b80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 shutdown_connections 2024-09-05T07:48:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:21.780+0000 7fe1bda00640 1 -- 172.21.15.144:0/848420438 wait complete. 2024-09-05T07:48:22.555 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T07:44:23.743416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T07:48:22.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-05T07:48:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:22 smithi144 ceph-mon[29535]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:22 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/848420438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:48:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:22 smithi175 ceph-mon[34585]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:22 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/848420438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:48:22.917 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:22.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:22 smithi154 ceph-mon[34710]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:22.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:22 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/848420438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 -- 172.21.15.144:0/114924082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 msgr2=0x7f2d64108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/114924082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d64108830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009900 tx=0x7f2d5002a410 comp rx=0 tx=0).stop 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 -- 172.21.15.144:0/114924082 shutdown_connections 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/114924082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64108f60 0x7f2d64110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/114924082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d64108830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/114924082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64103e30 0x7f2d64104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 -- 172.21.15.144:0/114924082 >> 172.21.15.144:0/114924082 conn(0x7f2d640ff8d0 msgr2=0x7f2d64101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 -- 172.21.15.144:0/114924082 shutdown_connections 2024-09-05T07:48:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.484+0000 7f2d6ae00640 1 -- 172.21.15.144:0/114924082 wait complete. 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 Processor -- start 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 -- start start 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d6419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64114010 con 0x7f2d641047e0 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64113e90 con 0x7f2d64103e30 2024-09-05T07:48:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.485+0000 7f2d6ae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64114190 con 0x7f2d64108f60 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d6a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:45588/0 (socket says 172.21.15.144:45588) 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d6a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:35338/0 (socket says 172.21.15.144:35338) 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 -- 172.21.15.144:0/921493635 learned_addr learned my addr 172.21.15.144:0/921493635 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69000640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d6419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 -- 172.21.15.144:0/921493635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 msgr2=0x7f2d6419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 -- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 msgr2=0x7f2d6419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d6419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d69a00640 1 -- 172.21.15.144:0/921493635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6419f440 con 0x7f2d64103e30 2024-09-05T07:48:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.486+0000 7f2d6a400640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:48:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d69a00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800e9f0 tx=0x7f2d5800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5800cd80 con 0x7f2d64103e30 2024-09-05T07:48:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d58005500 con 0x7f2d64103e30 2024-09-05T07:48:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6419f730 con 0x7f2d64103e30 2024-09-05T07:48:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58010690 con 0x7f2d64103e30 2024-09-05T07:48:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.487+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d641a7010 con 0x7f2d64103e30 2024-09-05T07:48:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.488+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d64104210 con 0x7f2d64103e30 2024-09-05T07:48:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.490+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2d580046c0 con 0x7f2d64103e30 2024-09-05T07:48:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.491+0000 7f2d62000640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 0x7f2d4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.491+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f2d580cefe0 con 0x7f2d64103e30 2024-09-05T07:48:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.491+0000 7f2d69000640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 0x7f2d4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.492+0000 7f2d69000640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 0x7f2d4c0a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.495+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d5809c380 con 0x7f2d64103e30 2024-09-05T07:48:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.669+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d6410c140 con 0x7f2d64103e30 2024-09-05T07:48:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.669+0000 7f2d62000640 1 -- 172.21.15.144:0/921493635 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f2d5809bc80 con 0x7f2d64103e30 2024-09-05T07:48:23.670 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-05T07:48:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.672+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 msgr2=0x7f2d4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.672+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 0x7f2d4c0a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50005b50 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.672+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 msgr2=0x7f2d6419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.672+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800e9f0 tx=0x7f2d5800edf0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 shutdown_connections 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f2d4c0a2b80 0x7f2d4c0a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d64108f60 0x7f2d6419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d641047e0 0x7f2d6419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 --2- 172.21.15.144:0/921493635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d64103e30 0x7f2d6419a490 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 >> 172.21.15.144:0/921493635 conn(0x7f2d640ff8d0 msgr2=0x7f2d64100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 shutdown_connections 2024-09-05T07:48:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:23.673+0000 7f2d6ae00640 1 -- 172.21.15.144:0/921493635 wait complete. 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.a on smithi144 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.d on smithi144 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.g on smithi144 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.j on smithi144 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.b on smithi154 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.e on smithi154 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.h on smithi154 2024-09-05T07:48:24.501 INFO:tasks.cephadm:Adding mds.k on smithi154 2024-09-05T07:48:24.502 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-09-05T07:48:24.502 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-09-05T07:48:24.502 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-09-05T07:48:24.502 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-09-05T07:48:24.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph orch apply mds all '12;smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-09-05T07:48:24.760 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:48:24.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:24 smithi144 ceph-mon[29535]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:24.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:24 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/921493635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:48:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:24 smithi175 ceph-mon[34585]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:24 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/921493635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:48:24.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:24 smithi154 ceph-mon[34710]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:24.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:24 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/921493635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:48:25.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 -- 172.21.15.175:0/2727916075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70101cd0 msgr2=0x7fdb70102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 --2- 172.21.15.175:0/2727916075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70101cd0 0x7fdb70102150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009900 tx=0x7fdb6002a410 comp rx=0 tx=0).stop 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 -- 172.21.15.175:0/2727916075 shutdown_connections 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 --2- 172.21.15.175:0/2727916075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70102690 0x7fdb70108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 --2- 172.21.15.175:0/2727916075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70101cd0 0x7fdb70102150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 --2- 172.21.15.175:0/2727916075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 0x7fdb70100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 -- 172.21.15.175:0/2727916075 >> 172.21.15.175:0/2727916075 conn(0x7fdb700fc280 msgr2=0x7fdb700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 -- 172.21.15.175:0/2727916075 shutdown_connections 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.248+0000 7fdb75521640 1 -- 172.21.15.175:0/2727916075 wait complete. 2024-09-05T07:48:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 Processor -- start 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 -- start start 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 0x7fdb70197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 0x7fdb70198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d8c0 con 0x7fdb70100ad0 2024-09-05T07:48:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d740 con 0x7fdb70101cd0 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.249+0000 7fdb75521640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010da40 con 0x7fdb70102690 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33828/0 (socket says 172.21.15.175:33828) 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 -- 172.21.15.175:0/2379482983 learned_addr learned my addr 172.21.15.175:0/2379482983 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6e7fc640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 0x7fdb70198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6effd640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 0x7fdb70197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 -- 172.21.15.175:0/2379482983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 msgr2=0x7fdb70198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 0x7fdb70198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 -- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 msgr2=0x7fdb70197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 0x7fdb70197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 -- 172.21.15.175:0/2379482983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7019fb70 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6e7fc640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 0x7fdb70198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb6f7fe640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800b970 tx=0x7fdb6800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68019070 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb6800cb40 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7019fe60 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68007650 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.250+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a0390 con 0x7fdb70102690 2024-09-05T07:48:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.251+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70107e70 con 0x7fdb70102690 2024-09-05T07:48:25.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.253+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdb6801c070 con 0x7fdb70102690 2024-09-05T07:48:25.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.254+0000 7fdb57fff640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 0x7fdb580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:25.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.254+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fdb680ce5a0 con 0x7fdb70102690 2024-09-05T07:48:25.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.254+0000 7fdb6effd640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 0x7fdb580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:25.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.255+0000 7fdb6effd640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 0x7fdb580a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb70101b30 tx=0x7fdb6400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:25.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.257+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb6809b350 con 0x7fdb70102690 2024-09-05T07:48:25.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.431+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7fdb70062730 con 0x7fdb580a2bb0 2024-09-05T07:48:25.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.439+0000 7fdb57fff640 1 -- 172.21.15.175:0/2379482983 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fdb70062730 con 0x7fdb580a2bb0 2024-09-05T07:48:25.440 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-09-05T07:48:25.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 msgr2=0x7fdb580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:25.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 0x7fdb580a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb70101b30 tx=0x7fdb6400a2d0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 msgr2=0x7fdb7019f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800b970 tx=0x7fdb6800be30 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 shutdown_connections 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdb580a2bb0 0x7fdb580a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb70101cd0 0x7fdb70198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb70102690 0x7fdb7019f500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 --2- 172.21.15.175:0/2379482983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb70100ad0 0x7fdb70197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 >> 172.21.15.175:0/2379482983 conn(0x7fdb700fc280 msgr2=0x7fdb70105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 shutdown_connections 2024-09-05T07:48:25.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-05T07:48:25.442+0000 7fdb75521640 1 -- 172.21.15.175:0/2379482983 wait complete. 2024-09-05T07:48:26.231 DEBUG:teuthology.orchestra.run.smithi144:mds.a> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.a.service 2024-09-05T07:48:26.236 DEBUG:teuthology.orchestra.run.smithi144:mds.d> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.d.service 2024-09-05T07:48:26.281 DEBUG:teuthology.orchestra.run.smithi144:mds.g> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.g.service 2024-09-05T07:48:26.326 DEBUG:teuthology.orchestra.run.smithi144:mds.j> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.j.service 2024-09-05T07:48:26.371 DEBUG:teuthology.orchestra.run.smithi154:mds.b> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.b.service 2024-09-05T07:48:26.373 DEBUG:teuthology.orchestra.run.smithi154:mds.e> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.e.service 2024-09-05T07:48:26.417 DEBUG:teuthology.orchestra.run.smithi154:mds.h> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.h.service 2024-09-05T07:48:26.460 DEBUG:teuthology.orchestra.run.smithi154:mds.k> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.k.service 2024-09-05T07:48:26.503 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.c.service 2024-09-05T07:48:26.506 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.f.service 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: Saving service mds.all spec with placement smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:26.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:26.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:26.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:26 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.527 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.i.service 2024-09-05T07:48:26.570 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.l.service 2024-09-05T07:48:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:48:26.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: Saving service mds.all spec with placement smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:26.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:26 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.613 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-05T07:48:26.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:48:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: Saving service mds.all spec with placement smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-05T07:48:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:26 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:27.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 -- 172.21.15.144:0/2585916702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 msgr2=0x7f0db410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 --2- 172.21.15.144:0/2585916702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db410ea90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009860 tx=0x7f0dac02a340 comp rx=0 tx=0).stop 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 -- 172.21.15.144:0/2585916702 shutdown_connections 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 --2- 172.21.15.144:0/2585916702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 --2- 172.21.15.144:0/2585916702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db410ea90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.490+0000 7f0db9600640 1 --2- 172.21.15.144:0/2585916702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.491+0000 7f0db9600640 1 -- 172.21.15.144:0/2585916702 >> 172.21.15.144:0/2585916702 conn(0x7f0db40fd8c0 msgr2=0x7f0db40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.491+0000 7f0db9600640 1 -- 172.21.15.144:0/2585916702 shutdown_connections 2024-09-05T07:48:27.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.491+0000 7f0db9600640 1 -- 172.21.15.144:0/2585916702 wait complete. 2024-09-05T07:48:27.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.492+0000 7f0db9600640 1 Processor -- start 2024-09-05T07:48:27.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.492+0000 7f0db9600640 1 -- start start 2024-09-05T07:48:27.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.492+0000 7f0db9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:27.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.492+0000 7f0db9600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4111f70 con 0x7f0db4101de0 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db9600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4111df0 con 0x7f0db4102790 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41120f0 con 0x7f0db4106f10 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40260/0 (socket says 172.21.15.144:40260) 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db2a00640 1 -- 172.21.15.144:0/490001017 learned_addr learned my addr 172.21.15.144:0/490001017 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0daa000640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 -- 172.21.15.144:0/490001017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 msgr2=0x7f0db4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 -- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 msgr2=0x7f0db40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db3400640 1 -- 172.21.15.144:0/490001017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db41a68b0 con 0x7f0db4106f10 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0daa000640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.493+0000 7f0db2a00640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0db3400640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db4074f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02a860 tx=0x7f0dac033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac03f020 con 0x7f0db4106f10 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dac032770 con 0x7f0db4106f10 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db41a6b40 con 0x7f0db4106f10 2024-09-05T07:48:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac037040 con 0x7f0db4106f10 2024-09-05T07:48:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.494+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db41a6ff0 con 0x7f0db4106f10 2024-09-05T07:48:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.495+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db41021c0 con 0x7f0db4106f10 2024-09-05T07:48:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.497+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0dac042070 con 0x7f0db4106f10 2024-09-05T07:48:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.498+0000 7f0dabe00640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 0x7f0d980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.498+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f0dac0edfe0 con 0x7f0db4106f10 2024-09-05T07:48:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.498+0000 7f0db2a00640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 0x7f0d980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.499+0000 7f0db2a00640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 0x7f0d980a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0da40096c0 tx=0x7f0da4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.502+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0dac0bb340 con 0x7f0db4106f10 2024-09-05T07:48:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.712+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0db410a0f0 con 0x7f0db4106f10 2024-09-05T07:48:27.713 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:27 smithi144 ceph-mon[29535]: Deploying daemon mds.l on smithi175 2024-09-05T07:48:27.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.713+0000 7f0dabe00640 1 -- 172.21.15.144:0/490001017 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0dac0bac40 con 0x7f0db4106f10 2024-09-05T07:48:27.714 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:27.714 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"btime":"2024-09-05T07:41:13:589495+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T07:48:27.714 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 1 2024-09-05T07:48:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 msgr2=0x7f0d980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 0x7f0d980a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0da40096c0 tx=0x7f0da4009260 comp rx=0 tx=0).stop 2024-09-05T07:48:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 msgr2=0x7f0db4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db4074f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02a860 tx=0x7f0dac033d10 comp rx=0 tx=0).stop 2024-09-05T07:48:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 shutdown_connections 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d980a2b80 0x7f0d980a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db4102790 0x7f0db4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db4106f10 0x7f0db4074f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 --2- 172.21.15.144:0/490001017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db4101de0 0x7f0db40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 >> 172.21.15.144:0/490001017 conn(0x7f0db40fd8c0 msgr2=0x7f0db40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 shutdown_connections 2024-09-05T07:48:27.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:27.716+0000 7f0db9600640 1 -- 172.21.15.144:0/490001017 wait complete. 2024-09-05T07:48:27.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:27 smithi175 ceph-mon[34585]: Deploying daemon mds.l on smithi175 2024-09-05T07:48:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:27 smithi154 ceph-mon[34710]: Deploying daemon mds.l on smithi175 2024-09-05T07:48:28.087 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:27 smithi175 systemd[1]: Starting Ceph mds.l for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:28.367 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 podman[64165]: 2024-09-05 07:48:28.015461248 +0000 UTC m=+0.015575680 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:28.367 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 podman[64165]: 2024-09-05 07:48:28.132014897 +0000 UTC m=+0.132129353 container create ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-05T07:48:28.368 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 podman[64165]: 2024-09-05 07:48:28.367722867 +0000 UTC m=+0.367837276 container init ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-05T07:48:28.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:28 smithi144 ceph-mon[29535]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:28 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/490001017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:28 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6832/3404092101,v1:172.21.15.175:6833/3404092101] up:boot 2024-09-05T07:48:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:28 smithi144 ceph-mon[29535]: fsmap 1 up:standby 2024-09-05T07:48:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mon[34585]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/490001017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6832/3404092101,v1:172.21.15.175:6833/3404092101] up:boot 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mon[34585]: fsmap 1 up:standby 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:48:28.837 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 podman[64165]: 2024-09-05 07:48:28.370661191 +0000 UTC m=+0.370775602 container start ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T07:48:28.838 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-mds[64184]: -- 172.21.15.175:0/3472604423 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641c8161860 con 0x5641c813f000 2024-09-05T07:48:28.838 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: starting mds.l at 2024-09-05T07:48:28.838 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 bash[64165]: ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 2024-09-05T07:48:28.838 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:48:28 smithi175 systemd[1]: Started Ceph mds.l for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:28 smithi154 ceph-mon[34710]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:28 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/490001017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:28 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6832/3404092101,v1:172.21.15.175:6833/3404092101] up:boot 2024-09-05T07:48:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:28 smithi154 ceph-mon[34710]: fsmap 1 up:standby 2024-09-05T07:48:28.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: Deploying daemon mds.k on smithi154 2024-09-05T07:48:29.638 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:29 smithi154 ceph-mon[34710]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: Deploying daemon mds.k on smithi154 2024-09-05T07:48:29.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:29 smithi144 ceph-mon[29535]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:29.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: Deploying daemon mds.k on smithi154 2024-09-05T07:48:29.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:29 smithi175 ceph-mon[34585]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:30.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:30.572 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:30 smithi154 systemd[1]: Starting Ceph mds.k for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:30.831 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:30 smithi154 podman[63145]: 2024-09-05 07:48:30.589289442 +0000 UTC m=+0.015860302 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:30.831 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:30 smithi154 podman[63145]: 2024-09-05 07:48:30.701745255 +0000 UTC m=+0.128316157 container create e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:48:30.896 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:31.090 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:30 smithi154 podman[63145]: 2024-09-05 07:48:30.971226647 +0000 UTC m=+0.397797506 container init e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-05T07:48:31.090 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:30 smithi154 podman[63145]: 2024-09-05 07:48:30.97409366 +0000 UTC m=+0.400664528 container start e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:48:31.437 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:31 smithi154 ceph-mds[63164]: -- 172.21.15.154:0/2140576358 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cfa1ecb860 con 0x55cfa1ea8800 2024-09-05T07:48:31.437 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: starting mds.k at 2024-09-05T07:48:31.437 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:31 smithi154 bash[63145]: e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 2024-09-05T07:48:31.437 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:48:31 smithi154 systemd[1]: Started Ceph mds.k for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:31.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 -- 172.21.15.144:0/2900232316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074620 msgr2=0x7fd880074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:31.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 --2- 172.21.15.144:0/2900232316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074620 0x7fd880074a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd874009900 tx=0x7fd87402a480 comp rx=0 tx=0).stop 2024-09-05T07:48:31.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 -- 172.21.15.144:0/2900232316 shutdown_connections 2024-09-05T07:48:31.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 --2- 172.21.15.144:0/2900232316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 0x7fd880110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 --2- 172.21.15.144:0/2900232316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074f40 0x7fd88010dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 --2- 172.21.15.144:0/2900232316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074620 0x7fd880074a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 -- 172.21.15.144:0/2900232316 >> 172.21.15.144:0/2900232316 conn(0x7fd8800fd710 msgr2=0x7fd8800ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:31.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.480+0000 7fd886c00640 1 -- 172.21.15.144:0/2900232316 shutdown_connections 2024-09-05T07:48:31.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.481+0000 7fd886c00640 1 -- 172.21.15.144:0/2900232316 wait complete. 2024-09-05T07:48:31.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.481+0000 7fd886c00640 1 Processor -- start 2024-09-05T07:48:31.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 -- start start 2024-09-05T07:48:31.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 0x7fd88019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:31.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 0x7fd88019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 0x7fd88019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd880113fd0 con 0x7fd880074620 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd880113e50 con 0x7fd880074f40 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd886c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd880114150 con 0x7fd88010e210 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd885800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 0x7fd88019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd885800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 0x7fd88019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40286/0 (socket says 172.21.15.144:40286) 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd885800640 1 -- 172.21.15.144:0/1852662752 learned_addr learned my addr 172.21.15.144:0/1852662752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.482+0000 7fd884e00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 0x7fd88019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd886200640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 0x7fd88019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 -- 172.21.15.144:0/1852662752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 msgr2=0x7fd88019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 0x7fd88019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 -- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 msgr2=0x7fd88019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:31.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 0x7fd88019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 -- 172.21.15.144:0/1852662752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88019f460 con 0x7fd880074f40 2024-09-05T07:48:31.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd884e00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 0x7fd88019a9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9f0 tx=0x7fd86c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:31.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00ccc0 con 0x7fd880074f40 2024-09-05T07:48:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd86c010910 con 0x7fd880074f40 2024-09-05T07:48:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.483+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88019f750 con 0x7fd880074f40 2024-09-05T07:48:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.484+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c018960 con 0x7fd880074f40 2024-09-05T07:48:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.484+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8801a7030 con 0x7fd880074f40 2024-09-05T07:48:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.485+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd880074a00 con 0x7fd880074f40 2024-09-05T07:48:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.486+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd86c010ac0 con 0x7fd880074f40 2024-09-05T07:48:31.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.488+0000 7fd87e000640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 0x7fd8680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:31.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.488+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fd86c0cefe0 con 0x7fd880074f40 2024-09-05T07:48:31.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.488+0000 7fd885800640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 0x7fd8680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.489+0000 7fd885800640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 0x7fd8680a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096c0 tx=0x7fd8740046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:31.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.491+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd86c09c340 con 0x7fd880074f40 2024-09-05T07:48:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.718+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd880108e00 con 0x7fd880074f40 2024-09-05T07:48:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.719+0000 7fd87e000640 1 -- 172.21.15.144:0/1852662752 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fd86c09bc40 con 0x7fd880074f40 2024-09-05T07:48:31.720 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:31.720 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"btime":"2024-09-05T07:48:31:146079+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-05T07:48:31.720 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 3 2024-09-05T07:48:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 msgr2=0x7fd8680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 0x7fd8680a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096c0 tx=0x7fd8740046c0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 msgr2=0x7fd88019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 0x7fd88019a9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9f0 tx=0x7fd86c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 shutdown_connections 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8680a2c00 0x7fd8680a50c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd880074f40 0x7fd88019a9f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88010e210 0x7fd88019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 --2- 172.21.15.144:0/1852662752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd880074620 0x7fd88019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 >> 172.21.15.144:0/1852662752 conn(0x7fd8800fd710 msgr2=0x7fd8800fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 shutdown_connections 2024-09-05T07:48:31.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:31.722+0000 7fd886c00640 1 -- 172.21.15.144:0/1852662752 wait complete. 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6832/292119763,v1:172.21.15.154:6833/292119763] up:boot 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: fsmap 2 up:standby 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:32.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:32.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:32.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: Deploying daemon mds.j on smithi144 2024-09-05T07:48:32.323 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:32 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1852662752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6832/292119763,v1:172.21.15.154:6833/292119763] up:boot 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: fsmap 2 up:standby 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: Deploying daemon mds.j on smithi144 2024-09-05T07:48:32.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:32 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1852662752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6832/292119763,v1:172.21.15.154:6833/292119763] up:boot 2024-09-05T07:48:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: fsmap 2 up:standby 2024-09-05T07:48:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:48:32.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: Deploying daemon mds.j on smithi144 2024-09-05T07:48:32.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:32 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1852662752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:34.286 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:34 smithi144 ceph-mon[29535]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:34.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:34.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:34 smithi175 ceph-mon[34585]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:34 smithi154 ceph-mon[34710]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:35.071 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:34 smithi144 systemd[1]: Starting Ceph mds.j for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:35.370 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 podman[68957]: 2024-09-05 07:48:35.013715443 +0000 UTC m=+0.031907237 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:35.370 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 podman[68957]: 2024-09-05 07:48:35.132848756 +0000 UTC m=+0.151040544 container create 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-05T07:48:35.370 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 podman[68957]: 2024-09-05 07:48:35.370015884 +0000 UTC m=+0.388207676 container init 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e) 2024-09-05T07:48:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 podman[68957]: 2024-09-05 07:48:35.376579234 +0000 UTC m=+0.394771022 container start 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 ceph-mds[69002]: -- 172.21.15.144:0/2273574106 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590ce632680 con 0x5590ce607400 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 ceph-mds[69002]: -- 172.21.15.144:0/2273574106 <== mon.0 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590ce629860 con 0x5590ce607400 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j[68997]: starting mds.j at 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 bash[68957]: 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea 2024-09-05T07:48:35.645 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:48:35 smithi144 systemd[1]: Started Ceph mds.j for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:36.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.066+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1504364354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e410e3c0 msgr2=0x7fe9e4110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.066+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1504364354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e410e3c0 0x7fe9e4110810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ca0 tx=0x7fe9dc02a950 comp rx=0 tx=0).stop 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1504364354 shutdown_connections 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1504364354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e4074f40 0x7fe9e410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1504364354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e410e3c0 0x7fe9e4110810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1504364354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 0x7fe9e4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1504364354 >> 172.21.15.144:0/1504364354 conn(0x7fe9e40fd8c0 msgr2=0x7fe9e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1504364354 shutdown_connections 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1504364354 wait complete. 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.067+0000 7fe9ebe00640 1 Processor -- start 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 -- start start 2024-09-05T07:48:36.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 0x7fe9e419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e410e3c0 0x7fe9e419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e41141b0 con 0x7fe9e4074f40 2024-09-05T07:48:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4114030 con 0x7fe9e410e3c0 2024-09-05T07:48:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4114330 con 0x7fe9e4074620 2024-09-05T07:48:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9e8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9e8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56360/0 (socket says 172.21.15.144:56360) 2024-09-05T07:48:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9e8a00640 1 -- 172.21.15.144:0/1390039767 learned_addr learned my addr 172.21.15.144:0/1390039767 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9e9400640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 0x7fe9e419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.068+0000 7fe9e9e00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e410e3c0 0x7fe9e419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 -- 172.21.15.144:0/1390039767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 msgr2=0x7fe9e419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 0x7fe9e419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 -- 172.21.15.144:0/1390039767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e410e3c0 msgr2=0x7fe9e419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e410e3c0 0x7fe9e419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 -- 172.21.15.144:0/1390039767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e419f600 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e8a00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000e9f0 tx=0x7fe9d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000cd80 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9d0010910 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e419f8f0 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.069+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0018990 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.070+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41a71d0 con 0x7fe9e4074f40 2024-09-05T07:48:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.071+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e4074a00 con 0x7fe9e4074f40 2024-09-05T07:48:36.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.073+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe9d0010ac0 con 0x7fe9e4074f40 2024-09-05T07:48:36.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.074+0000 7fe9e2000640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 0x7fe9cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:36.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.075+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fe9d00cf330 con 0x7fe9e4074f40 2024-09-05T07:48:36.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.075+0000 7fe9e9400640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 0x7fe9cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:36.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.075+0000 7fe9e9400640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 0x7fe9cc0a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009bd0 tx=0x7fe9d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:36.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.077+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9d009c040 con 0x7fe9e4074f40 2024-09-05T07:48:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.320+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e419b9b0 con 0x7fe9e4074f40 2024-09-05T07:48:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.321+0000 7fe9e2000640 1 -- 172.21.15.144:0/1390039767 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fe9d00a0340 con 0x7fe9e4074f40 2024-09-05T07:48:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:36.322 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":4,"btime":"2024-09-05T07:48:36:287152+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-05T07:48:36.322 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 4 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 msgr2=0x7fe9cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 0x7fe9cc0a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009bd0 tx=0x7fe9d8005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 msgr2=0x7fe9e419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000e9f0 tx=0x7fe9d000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 shutdown_connections 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe9cc0a2b80 0x7fe9cc0a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e410e3c0 0x7fe9e419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e4074f40 0x7fe9e419ab90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 --2- 172.21.15.144:0/1390039767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9e4074620 0x7fe9e419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:36.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 >> 172.21.15.144:0/1390039767 conn(0x7fe9e40fd8c0 msgr2=0x7fe9e40fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 shutdown_connections 2024-09-05T07:48:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:36.323+0000 7fe9ebe00640 1 -- 172.21.15.144:0/1390039767 wait complete. 2024-09-05T07:48:36.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:36.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:36 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:36.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:36.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:36 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:36.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:36.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:36 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:37.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:37 smithi144 ceph-mon[29535]: Deploying daemon mds.d on smithi144 2024-09-05T07:48:37.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:37 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6834/3359383404,v1:172.21.15.144:6835/3359383404] up:boot 2024-09-05T07:48:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:37 smithi144 ceph-mon[29535]: fsmap 3 up:standby 2024-09-05T07:48:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:37 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T07:48:37.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:37 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1390039767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:37 smithi175 ceph-mon[34585]: Deploying daemon mds.d on smithi144 2024-09-05T07:48:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:37 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6834/3359383404,v1:172.21.15.144:6835/3359383404] up:boot 2024-09-05T07:48:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:37 smithi175 ceph-mon[34585]: fsmap 3 up:standby 2024-09-05T07:48:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:37 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T07:48:37.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:37 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1390039767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:37 smithi154 ceph-mon[34710]: Deploying daemon mds.d on smithi144 2024-09-05T07:48:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:37 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6834/3359383404,v1:172.21.15.144:6835/3359383404] up:boot 2024-09-05T07:48:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:37 smithi154 ceph-mon[34710]: fsmap 3 up:standby 2024-09-05T07:48:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:37 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T07:48:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:37 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1390039767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:38.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:38 smithi144 ceph-mon[29535]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:38.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:38 smithi175 ceph-mon[34585]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:38 smithi154 ceph-mon[34710]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:39.179 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:38 smithi144 systemd[1]: Starting Ceph mds.d for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:39.572 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 podman[69339]: 2024-09-05 07:48:39.082894277 +0000 UTC m=+0.027587565 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:39.572 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 podman[69339]: 2024-09-05 07:48:39.230427768 +0000 UTC m=+0.175121047 container create 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-05T07:48:39.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 podman[69339]: 2024-09-05 07:48:39.60016535 +0000 UTC m=+0.544858642 container init 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 podman[69339]: 2024-09-05 07:48:39.606478904 +0000 UTC m=+0.551172185 container start 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux ) 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 ceph-mds[69358]: -- 172.21.15.144:0/3762164609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dfc6c9a680 con 0x55dfc6c6f400 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 ceph-mds[69358]: -- 172.21.15.144:0/3762164609 <== mon.0 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dfc6c91c20 con 0x55dfc6c6f400 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: starting mds.d at 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 bash[69339]: 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 2024-09-05T07:48:40.072 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:48:39 smithi144 systemd[1]: Started Ceph mds.d for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:40.517 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:40 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:40.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:40.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:40 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:40.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:40.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:40.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:40 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.731+0000 7f489a200640 1 -- 172.21.15.144:0/1001830066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48941047e0 msgr2=0x7f4894108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.731+0000 7f489a200640 1 --2- 172.21.15.144:0/1001830066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48941047e0 0x7f4894108830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4880009900 tx=0x7f488002a410 comp rx=0 tx=0).stop 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 -- 172.21.15.144:0/1001830066 shutdown_connections 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 --2- 172.21.15.144:0/1001830066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f4894110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 --2- 172.21.15.144:0/1001830066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48941047e0 0x7f4894108830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 --2- 172.21.15.144:0/1001830066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4894103e30 0x7f4894104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 -- 172.21.15.144:0/1001830066 >> 172.21.15.144:0/1001830066 conn(0x7f48940ff8d0 msgr2=0x7f4894101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 -- 172.21.15.144:0/1001830066 shutdown_connections 2024-09-05T07:48:40.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.732+0000 7f489a200640 1 -- 172.21.15.144:0/1001830066 wait complete. 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 Processor -- start 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 -- start start 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4894103e30 0x7f489419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f489419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4894114010 con 0x7f4894103e30 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4894113e90 con 0x7f48941047e0 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.733+0000 7f489a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4894114190 con 0x7f4894108f60 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4898e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4894103e30 0x7f489419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:45872/0 (socket says 172.21.15.144:45872) 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 -- 172.21.15.144:0/3055155706 learned_addr learned my addr 172.21.15.144:0/3055155706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4899800640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f489419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 -- 172.21.15.144:0/3055155706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 msgr2=0x7f489419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f489419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 -- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4894103e30 msgr2=0x7f489419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4894103e30 0x7f489419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 -- 172.21.15.144:0/3055155706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489419f400 con 0x7f48941047e0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4899800640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f489419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4893e00640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f488002aa00 tx=0x7f4880003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.734+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488003f070 con 0x7f48941047e0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.735+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4880031ca0 con 0x7f48941047e0 2024-09-05T07:48:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.735+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880035030 con 0x7f48941047e0 2024-09-05T07:48:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.735+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489419f690 con 0x7f48941047e0 2024-09-05T07:48:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.735+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489419fb20 con 0x7f48941047e0 2024-09-05T07:48:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.736+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4894104210 con 0x7f48941047e0 2024-09-05T07:48:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.738+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4880042070 con 0x7f48941047e0 2024-09-05T07:48:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.739+0000 7f4891600640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 0x7f487c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.739+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f48800ef310 con 0x7f48941047e0 2024-09-05T07:48:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.739+0000 7f4898e00640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 0x7f487c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.740+0000 7f4898e00640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 0x7f487c0a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4888009bd0 tx=0x7f4888005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.743+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48800bc710 con 0x7f48941047e0 2024-09-05T07:48:40.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.952+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f489410c1d0 con 0x7f48941047e0 2024-09-05T07:48:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.953+0000 7f4891600640 1 -- 172.21.15.144:0/3055155706 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3919 (secure 0 0 0) 0x7f48800bc010 con 0x7f48941047e0 2024-09-05T07:48:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:40.953 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":5,"btime":"2024-09-05T07:48:40:303678+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2024-09-05T07:48:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 5 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 msgr2=0x7f487c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 0x7f487c0a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4888009bd0 tx=0x7f4888005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 msgr2=0x7f489419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f488002aa00 tx=0x7f4880003c10 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 shutdown_connections 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f487c0a2c00 0x7f487c0a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48941047e0 0x7f489419a990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894108f60 0x7f489419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 --2- 172.21.15.144:0/3055155706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4894103e30 0x7f489419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 >> 172.21.15.144:0/3055155706 conn(0x7f48940ff8d0 msgr2=0x7f4894100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:40.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 shutdown_connections 2024-09-05T07:48:40.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:40.956+0000 7f489a200640 1 -- 172.21.15.144:0/3055155706 wait complete. 2024-09-05T07:48:41.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:41 smithi154 ceph-mon[34710]: Deploying daemon mds.e on smithi154 2024-09-05T07:48:41.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:41 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6836/2196844760,v1:172.21.15.144:6837/2196844760] up:boot 2024-09-05T07:48:41.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:41 smithi154 ceph-mon[34710]: fsmap 4 up:standby 2024-09-05T07:48:41.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:41 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:48:41.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:41 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3055155706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:41 smithi144 ceph-mon[29535]: Deploying daemon mds.e on smithi154 2024-09-05T07:48:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:41 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6836/2196844760,v1:172.21.15.144:6837/2196844760] up:boot 2024-09-05T07:48:41.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:41 smithi144 ceph-mon[29535]: fsmap 4 up:standby 2024-09-05T07:48:41.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:41 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:48:41.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3055155706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:41 smithi175 ceph-mon[34585]: Deploying daemon mds.e on smithi154 2024-09-05T07:48:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:41 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6836/2196844760,v1:172.21.15.144:6837/2196844760] up:boot 2024-09-05T07:48:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:41 smithi175 ceph-mon[34585]: fsmap 4 up:standby 2024-09-05T07:48:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:41 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:48:41.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:41 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3055155706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:42.187 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 systemd[1]: Starting Ceph mds.e for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:42.561 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:42 smithi154 ceph-mon[34710]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:42.561 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 podman[63465]: 2024-09-05 07:48:42.173535371 +0000 UTC m=+0.016001056 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:42.561 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 podman[63465]: 2024-09-05 07:48:42.291796741 +0000 UTC m=+0.134262419 container create 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-05T07:48:42.561 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 podman[63465]: 2024-09-05 07:48:42.561366259 +0000 UTC m=+0.403831947 container init 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-05T07:48:42.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:42 smithi144 ceph-mon[29535]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:42.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:42 smithi175 ceph-mon[34585]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:42.937 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 podman[63465]: 2024-09-05 07:48:42.564241352 +0000 UTC m=+0.406707031 container start 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:48:42.937 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 ceph-mds[63483]: -- 172.21.15.154:0/2635503634 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c411c3860 con 0x563c411a1000 2024-09-05T07:48:42.937 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: starting mds.e at 2024-09-05T07:48:42.937 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 bash[63465]: 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 2024-09-05T07:48:42.937 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:48:42 smithi154 systemd[1]: Started Ceph mds.e for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:43.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:43.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: Deploying daemon mds.f on smithi175 2024-09-05T07:48:43.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:43.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6834/2155086348,v1:172.21.15.154:6835/2155086348] up:boot 2024-09-05T07:48:43.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: fsmap 5 up:standby 2024-09-05T07:48:43.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:43 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: Deploying daemon mds.f on smithi175 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6834/2155086348,v1:172.21.15.154:6835/2155086348] up:boot 2024-09-05T07:48:43.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: fsmap 5 up:standby 2024-09-05T07:48:43.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:43 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:48:44.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: Deploying daemon mds.f on smithi175 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6834/2155086348,v1:172.21.15.154:6835/2155086348] up:boot 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: fsmap 5 up:standby 2024-09-05T07:48:44.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:43 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:48:44.106 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:44.837 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:44 smithi175 systemd[1]: Starting Ceph mds.f for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:44.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.839+0000 7f8cb3200640 1 -- 172.21.15.144:0/4236249709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40745c0 msgr2=0x7f8cb40749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:44.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.839+0000 7f8cb3200640 1 --2- 172.21.15.144:0/4236249709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40745c0 0x7f8cb40749a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009900 tx=0x7f8ca402a480 comp rx=0 tx=0).stop 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 -- 172.21.15.144:0/4236249709 shutdown_connections 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 --2- 172.21.15.144:0/4236249709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb410e260 0x7f8cb4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 --2- 172.21.15.144:0/4236249709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb4074ee0 0x7f8cb410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 --2- 172.21.15.144:0/4236249709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40745c0 0x7f8cb40749a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 -- 172.21.15.144:0/4236249709 >> 172.21.15.144:0/4236249709 conn(0x7f8cb40fd6e0 msgr2=0x7f8cb40ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 -- 172.21.15.144:0/4236249709 shutdown_connections 2024-09-05T07:48:44.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.840+0000 7f8cb3200640 1 -- 172.21.15.144:0/4236249709 wait complete. 2024-09-05T07:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 Processor -- start 2024-09-05T07:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 -- start start 2024-09-05T07:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 0x7f8cb419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4113fb0 con 0x7f8cb410e260 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4113e30 con 0x7f8cb4074ee0 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4114130 con 0x7f8cb40745c0 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.841+0000 7f8cb2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 0x7f8cb419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 0x7f8cb419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33508/0 (socket says 172.21.15.144:33508) 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb2800640 1 -- 172.21.15.144:0/1599419 learned_addr learned my addr 172.21.15.144:0/1599419 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:37700/0 (socket says 172.21.15.144:37700) 2024-09-05T07:48:44.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8ca9400640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:44.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 -- 172.21.15.144:0/1599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4074ee0 msgr2=0x7f8cb419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:44.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:44.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 -- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 msgr2=0x7f8cb419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:44.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 0x7f8cb419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:44.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 -- 172.21.15.144:0/1599419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb419f440 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cb1e00640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005940 tx=0x7f8ca40040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca403f030 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca40044c0 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.842+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4035070 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.843+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb419f6d0 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.843+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb419fb60 con 0x7f8cb40745c0 2024-09-05T07:48:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.844+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40749a0 con 0x7f8cb40745c0 2024-09-05T07:48:44.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.845+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8ca4042030 con 0x7f8cb40745c0 2024-09-05T07:48:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.847+0000 7f8cab400640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.847+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f8ca40eeed0 con 0x7f8cb40745c0 2024-09-05T07:48:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.847+0000 7f8ca9400640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:44.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.847+0000 7f8ca9400640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 0x7f8c980a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8cb410f580 tx=0x7f8c9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:44.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:44.851+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ca40bbbe0 con 0x7f8cb40745c0 2024-09-05T07:48:45.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.056+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb4109440 con 0x7f8cb40745c0 2024-09-05T07:48:45.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.057+0000 7f8cab400640 1 -- 172.21.15.144:0/1599419 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4747 (secure 0 0 0) 0x7f8ca40bfee0 con 0x7f8cb40745c0 2024-09-05T07:48:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:45.058 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":6,"btime":"2024-09-05T07:48:43:318573+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-05T07:48:45.059 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 6 2024-09-05T07:48:45.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.059+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 msgr2=0x7f8c980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:45.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.059+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 0x7f8c980a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8cb410f580 tx=0x7f8c9c005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.059+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 msgr2=0x7f8cb419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.059+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005940 tx=0x7f8ca40040c0 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 shutdown_connections 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb410e260 0x7f8cb419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 --2- 172.21.15.144:0/1599419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:45.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 >> 172.21.15.144:0/1599419 conn(0x7f8cb40fd6e0 msgr2=0x7f8cb40fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:45.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 shutdown_connections 2024-09-05T07:48:45.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:45.060+0000 7f8cb3200640 1 -- 172.21.15.144:0/1599419 wait complete. 2024-09-05T07:48:45.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:45 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1599419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:45.202 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:44 smithi175 podman[64466]: 2024-09-05 07:48:44.835367985 +0000 UTC m=+0.015809750 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:45.202 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:44 smithi175 podman[64466]: 2024-09-05 07:48:44.958333351 +0000 UTC m=+0.138775111 container create 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-05T07:48:45.202 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 podman[64466]: 2024-09-05 07:48:45.202457649 +0000 UTC m=+0.382899401 container init 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:48:45.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:45 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1599419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:45.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:45 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1599419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 podman[64466]: 2024-09-05 07:48:45.205729144 +0000 UTC m=+0.386170922 container start 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-05T07:48:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 ceph-mds[64485]: -- 172.21.15.175:0/1129972132 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e14913f860 con 0x55e14911d400 2024-09-05T07:48:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: starting mds.f at 2024-09-05T07:48:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 bash[64466]: 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 2024-09-05T07:48:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:48:45 smithi175 systemd[1]: Started Ceph mds.f for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: Deploying daemon mds.c on smithi175 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:boot 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: fsmap 6 up:standby 2024-09-05T07:48:46.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:46 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:48:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: Deploying daemon mds.c on smithi175 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:boot 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: fsmap 6 up:standby 2024-09-05T07:48:46.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:46 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:46.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: Deploying daemon mds.c on smithi175 2024-09-05T07:48:46.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:boot 2024-09-05T07:48:46.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: fsmap 6 up:standby 2024-09-05T07:48:46.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:46 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:48:47.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:48.087 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:48:47 smithi175 systemd[1]: Started Ceph mds.c for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:48.197 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:48.477 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:48 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:48.648 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:48.649 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:48 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 -- 172.21.15.144:0/3769624168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f010e430 msgr2=0x7ff1f0110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3769624168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f010e430 0x7ff1f0110820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009900 tx=0x7ff1e802a480 comp rx=0 tx=0).stop 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 -- 172.21.15.144:0/3769624168 shutdown_connections 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3769624168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f010e430 0x7ff1f0110820 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3769624168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f0074ee0 0x7ff1f010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3769624168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f00745c0 0x7ff1f00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 -- 172.21.15.144:0/3769624168 >> 172.21.15.144:0/3769624168 conn(0x7ff1f00fd8b0 msgr2=0x7ff1f00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 -- 172.21.15.144:0/3769624168 shutdown_connections 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.777+0000 7ff1f6800640 1 -- 172.21.15.144:0/3769624168 wait complete. 2024-09-05T07:48:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.778+0000 7ff1f6800640 1 Processor -- start 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.778+0000 7ff1f6800640 1 -- start start 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 0x7ff1f019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f010e430 0x7ff1f019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01141d0 con 0x7ff1f00745c0 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0114050 con 0x7ff1f0074ee0 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1f6800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0114350 con 0x7ff1f010e430 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 0x7ff1f019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:33318/0 (socket says 172.21.15.144:33318) 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 0x7ff1f019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33528/0 (socket says 172.21.15.144:33528) 2024-09-05T07:48:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 -- 172.21.15.144:0/3755966297 learned_addr learned my addr 172.21.15.144:0/3755966297 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 -- 172.21.15.144:0/3755966297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f010e430 msgr2=0x7ff1f019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f010e430 0x7ff1f019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 -- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 msgr2=0x7ff1f019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 0x7ff1f019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.779+0000 7ff1eea00640 1 -- 172.21.15.144:0/3755966297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f019f5f0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1eea00640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9f0 tx=0x7ff1d800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800cd80 con 0x7ff1f0074ee0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d8005500 con 0x7ff1f0074ee0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f019f8e0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8010690 con 0x7ff1f0074ee0 2024-09-05T07:48:48.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.780+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01a71c0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.781+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f00749a0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.783+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff1d80046c0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.785+0000 7ff1e7e00640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 0x7ff1d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.785+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7ff1d80cefe0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.785+0000 7ff1ef400640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 0x7ff1d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.786+0000 7ff1ef400640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 0x7ff1d40a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00099a0 tx=0x7ff1e0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:48.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:48.788+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1d809c3a0 con 0x7ff1f0074ee0 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:48 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:49.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.000+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1f002d7c0 con 0x7ff1f0074ee0 2024-09-05T07:48:49.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.001+0000 7ff1e7e00640 1 -- 172.21.15.144:0/3755966297 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7ff1d809bca0 con 0x7ff1f0074ee0 2024-09-05T07:48:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:49.002 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-05T07:48:48:337790+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-05T07:48:49.002 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 msgr2=0x7ff1d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 0x7ff1d40a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00099a0 tx=0x7ff1e0009500 comp rx=0 tx=0).stop 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 msgr2=0x7ff1f019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9f0 tx=0x7ff1d800edf0 comp rx=0 tx=0).stop 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 shutdown_connections 2024-09-05T07:48:49.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff1d40a2c00 0x7ff1d40a50c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f0074ee0 0x7ff1f019ab80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f010e430 0x7ff1f019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 --2- 172.21.15.144:0/3755966297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f00745c0 0x7ff1f019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 >> 172.21.15.144:0/3755966297 conn(0x7ff1f00fd8b0 msgr2=0x7ff1f00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 shutdown_connections 2024-09-05T07:48:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:49.003+0000 7ff1f6800640 1 -- 172.21.15.144:0/3755966297 wait complete. 2024-09-05T07:48:49.603 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:49 smithi154 ceph-mon[34710]: Deploying daemon mds.h on smithi154 2024-09-05T07:48:49.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:49 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:boot 2024-09-05T07:48:49.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:49 smithi154 ceph-mon[34710]: fsmap 7 up:standby 2024-09-05T07:48:49.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:49 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:48:49.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:49 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3755966297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:49.759 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:49 smithi144 ceph-mon[29535]: Deploying daemon mds.h on smithi154 2024-09-05T07:48:49.759 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:49 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:boot 2024-09-05T07:48:49.759 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:49 smithi144 ceph-mon[29535]: fsmap 7 up:standby 2024-09-05T07:48:49.760 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:49 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:48:49.760 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:49 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3755966297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:49.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:49 smithi175 ceph-mon[34585]: Deploying daemon mds.h on smithi154 2024-09-05T07:48:49.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:49 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:boot 2024-09-05T07:48:49.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:49 smithi175 ceph-mon[34585]: fsmap 7 up:standby 2024-09-05T07:48:49.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:49 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:48:49.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:49 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3755966297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:50.353 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 podman[63777]: 2024-09-05 07:48:50.24112154 +0000 UTC m=+0.136170444 container create a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:48:50.610 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:50 smithi154 ceph-mon[34710]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:50.610 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 podman[63777]: 2024-09-05 07:48:50.510772977 +0000 UTC m=+0.405821835 container init a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:48:50.611 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 podman[63777]: 2024-09-05 07:48:50.513642454 +0000 UTC m=+0.408691323 container start a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-05T07:48:50.611 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 ceph-mds[63796]: -- 172.21.15.154:0/4060734860 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c19d71860 con 0x559c19d4e800 2024-09-05T07:48:50.611 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: starting mds.h at 2024-09-05T07:48:50.611 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 bash[63777]: a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 2024-09-05T07:48:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:50 smithi144 ceph-mon[29535]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:50 smithi175 ceph-mon[34585]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:50.937 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:48:50 smithi154 systemd[1]: Started Ceph mds.h for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:51.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:51.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:51.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:51.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:51.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: Deploying daemon mds.i on smithi175 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6836/4186875626,v1:172.21.15.154:6837/4186875626] up:boot 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: fsmap 8 up:standby 2024-09-05T07:48:51.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:51 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:48:52.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: Deploying daemon mds.i on smithi175 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6836/4186875626,v1:172.21.15.154:6837/4186875626] up:boot 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: fsmap 8 up:standby 2024-09-05T07:48:52.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:51 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:48:52.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: Deploying daemon mds.i on smithi175 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6836/4186875626,v1:172.21.15.154:6837/4186875626] up:boot 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: fsmap 8 up:standby 2024-09-05T07:48:52.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:51 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:48:52.176 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:52.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 -- 172.21.15.144:0/3425542800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 msgr2=0x7f9680114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 --2- 172.21.15.144:0/3425542800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f9680114e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9678009ca0 tx=0x7f967802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 -- 172.21.15.144:0/3425542800 shutdown_connections 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 --2- 172.21.15.144:0/3425542800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680077040 0x7f9680112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 --2- 172.21.15.144:0/3425542800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f9680114e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 --2- 172.21.15.144:0/3425542800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680076720 0x7f9680076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.730+0000 7f9686e00640 1 -- 172.21.15.144:0/3425542800 >> 172.21.15.144:0/3425542800 conn(0x7f96800ffa50 msgr2=0x7f9680101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.731+0000 7f9686e00640 1 -- 172.21.15.144:0/3425542800 shutdown_connections 2024-09-05T07:48:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.731+0000 7f9686e00640 1 -- 172.21.15.144:0/3425542800 wait complete. 2024-09-05T07:48:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 Processor -- start 2024-09-05T07:48:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 -- start start 2024-09-05T07:48:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 0x7f96801a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f968019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96801185e0 con 0x7f9680112a50 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9680118460 con 0x7f9680076720 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9686e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9680118760 con 0x7f9680077040 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f967fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 0x7f96801a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f967f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.732+0000 7f9684e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f968019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:37738/0 (socket says 172.21.15.144:37738) 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 0x7f96801a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:33324/0 (socket says 172.21.15.144:33324) 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 -- 172.21.15.144:0/3860400397 learned_addr learned my addr 172.21.15.144:0/3860400397 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 -- 172.21.15.144:0/3860400397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 msgr2=0x7f96801a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 0x7f96801a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 -- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 msgr2=0x7f968019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f968019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 -- 172.21.15.144:0/3860400397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968019efc0 con 0x7f9680077040 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967f400640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f966c00e9f0 tx=0x7f966c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c00cd80 con 0x7f9680077040 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966c010910 con 0x7f9680077040 2024-09-05T07:48:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c018990 con 0x7f9680077040 2024-09-05T07:48:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.733+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968019f2b0 con 0x7f9680077040 2024-09-05T07:48:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.734+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801ab5a0 con 0x7f9680077040 2024-09-05T07:48:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.735+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680076b00 con 0x7f9680077040 2024-09-05T07:48:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.737+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f966c010ac0 con 0x7f9680077040 2024-09-05T07:48:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.738+0000 7f967cc00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 0x7f96640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.738+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f966c0cf450 con 0x7f9680077040 2024-09-05T07:48:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.739+0000 7f967fe00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 0x7f96640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.739+0000 7f967fe00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 0x7f96640a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f968019f9d0 tx=0x7f9670005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.740+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f966c09c160 con 0x7f9680077040 2024-09-05T07:48:52.837 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:52 smithi175 systemd[1]: Starting Ceph mds.i for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.953+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96801ab890 con 0x7f9680077040 2024-09-05T07:48:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.954+0000 7f967cc00640 1 -- 172.21.15.144:0/3860400397 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7228 (secure 0 0 0) 0x7f966c0a0460 con 0x7f9680077040 2024-09-05T07:48:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:52.955 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"btime":"2024-09-05T07:48:51:352732+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-05T07:48:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2024-09-05T07:48:52.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.956+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 msgr2=0x7f96640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:52.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.956+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 0x7f96640a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f968019f9d0 tx=0x7f9670005f90 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.956+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 msgr2=0x7f96801a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.956+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f966c00e9f0 tx=0x7f966c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 shutdown_connections 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f96640a2b80 0x7f96640a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9680112a50 0x7f968019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9680077040 0x7f96801a4c10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 --2- 172.21.15.144:0/3860400397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680076720 0x7f96801a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 >> 172.21.15.144:0/3860400397 conn(0x7f96800ffa50 msgr2=0x7f9680101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 shutdown_connections 2024-09-05T07:48:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:52.957+0000 7f9686e00640 1 -- 172.21.15.144:0/3860400397 wait complete. 2024-09-05T07:48:53.162 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:53 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3860400397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:53.163 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:52 smithi175 podman[65084]: 2024-09-05 07:48:52.769617922 +0000 UTC m=+0.015810593 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:53.163 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:52 smithi175 podman[65084]: 2024-09-05 07:48:52.893566573 +0000 UTC m=+0.139759284 container create 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e) 2024-09-05T07:48:53.163 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 podman[65084]: 2024-09-05 07:48:53.16313 +0000 UTC m=+0.409322662 container init 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-05T07:48:53.314 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:53 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3860400397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:53.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:53 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3860400397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:53.587 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 podman[65084]: 2024-09-05 07:48:53.166098678 +0000 UTC m=+0.412291341 container start 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-05T07:48:53.587 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 ceph-mds[65103]: -- 172.21.15.175:0/138831501 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c0d7bb1860 con 0x55c0d7b8f000 2024-09-05T07:48:53.587 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: starting mds.i at 2024-09-05T07:48:53.587 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 bash[65084]: 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 2024-09-05T07:48:53.587 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:48:53 smithi175 systemd[1]: Started Ceph mds.i for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: Deploying daemon mds.g on smithi144 2024-09-05T07:48:54.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:boot 2024-09-05T07:48:54.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: fsmap 9 up:standby 2024-09-05T07:48:54.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:54 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: Deploying daemon mds.g on smithi144 2024-09-05T07:48:54.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:boot 2024-09-05T07:48:54.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: fsmap 9 up:standby 2024-09-05T07:48:54.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:54 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:54.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:54.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: Deploying daemon mds.g on smithi144 2024-09-05T07:48:54.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:boot 2024-09-05T07:48:54.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: fsmap 9 up:standby 2024-09-05T07:48:54.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:54 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:48:55.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:48:56.176 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:55 smithi144 systemd[1]: Starting Ceph mds.g for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:48:56.456 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:56 smithi144 ceph-mon[29535]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:56.456 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 podman[70131]: 2024-09-05 07:48:56.080143204 +0000 UTC m=+0.030182610 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:48:56.457 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 podman[70131]: 2024-09-05 07:48:56.195189206 +0000 UTC m=+0.145228588 container create a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-05T07:48:56.457 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 podman[70131]: 2024-09-05 07:48:56.456547379 +0000 UTC m=+0.406586761 container init a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g, RELEASE=squid-91c8a7e, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-05T07:48:56.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:56 smithi175 ceph-mon[34585]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:56.635 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:48:56.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:56 smithi154 ceph-mon[34710]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:56.777 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 podman[70131]: 2024-09-05 07:48:56.463256854 +0000 UTC m=+0.413296237 container start a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:48:56.777 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 ceph-mds[70166]: -- 172.21.15.144:0/234795178 <== mon.0 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560deb8abc20 con 0x560deb888800 2024-09-05T07:48:56.777 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g[70162]: starting mds.g at 2024-09-05T07:48:56.777 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 bash[70131]: a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c 2024-09-05T07:48:56.777 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:48:56 smithi144 systemd[1]: Started Ceph mds.g for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:48:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 -- 172.21.15.144:0/3300404414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 msgr2=0x7f425c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 --2- 172.21.15.144:0/3300404414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c101e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4244009930 tx=0x7f424402a420 comp rx=0 tx=0).stop 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 -- 172.21.15.144:0/3300404414 shutdown_connections 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 --2- 172.21.15.144:0/3300404414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c102360 0x7f425c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 --2- 172.21.15.144:0/3300404414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c101e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 --2- 172.21.15.144:0/3300404414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c1079c0 0x7f425c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 -- 172.21.15.144:0/3300404414 >> 172.21.15.144:0/3300404414 conn(0x7f425c0fd6e0 msgr2=0x7f425c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 -- 172.21.15.144:0/3300404414 shutdown_connections 2024-09-05T07:48:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.187+0000 7f4262000640 1 -- 172.21.15.144:0/3300404414 wait complete. 2024-09-05T07:48:57.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.188+0000 7f4262000640 1 Processor -- start 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.188+0000 7f4262000640 1 -- start start 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c102360 0x7f425c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c1079c0 0x7f425c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f425c111dd0 con 0x7f425c1019c0 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f425c111c50 con 0x7f425c102360 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4262000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f425c111f50 con 0x7f425c1079c0 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4260c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4260c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50580/0 (socket says 172.21.15.144:50580) 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4260c00640 1 -- 172.21.15.144:0/2797572677 learned_addr learned my addr 172.21.15.144:0/2797572677 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4253e00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c102360 0x7f425c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.189+0000 7f4261600640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c1079c0 0x7f425c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 -- 172.21.15.144:0/2797572677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c1079c0 msgr2=0x7f425c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c1079c0 0x7f425c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 -- 172.21.15.144:0/2797572677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c102360 msgr2=0x7f425c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c102360 0x7f425c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 -- 172.21.15.144:0/2797572677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c19d240 con 0x7f425c1019c0 2024-09-05T07:48:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4260c00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f424c00d950 tx=0x7f424c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c017070 con 0x7f425c1019c0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f424c009c30 con 0x7f425c1019c0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00f6b0 con 0x7f425c1019c0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.190+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c19d530 con 0x7f425c1019c0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.191+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c1a4e10 con 0x7f425c1019c0 2024-09-05T07:48:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.192+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425c103100 con 0x7f425c1019c0 2024-09-05T07:48:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.194+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f424c0109d0 con 0x7f425c1019c0 2024-09-05T07:48:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.195+0000 7f425a000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 0x7f42400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:48:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.195+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f424c0ce740 con 0x7f425c1019c0 2024-09-05T07:48:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.195+0000 7f4253e00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 0x7f42400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:48:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.196+0000 7f4253e00640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 0x7f42400a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4244006010 tx=0x7f4244000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:48:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.201+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f424c009de0 con 0x7f425c1019c0 2024-09-05T07:48:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.425+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f425c1a5040 con 0x7f425c1019c0 2024-09-05T07:48:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.426+0000 7f425a000640 1 -- 172.21.15.144:0/2797572677 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8884 (secure 0 0 0) 0x7f424c09b450 con 0x7f425c1019c0 2024-09-05T07:48:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:48:57.428 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":11,"btime":"2024-09-05T07:48:57:328373+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T07:48:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 11 2024-09-05T07:48:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.428+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 msgr2=0x7f42400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.428+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 0x7f42400a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4244006010 tx=0x7f4244000bc0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.428+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 msgr2=0x7f425c198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.428+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f424c00d950 tx=0x7f424c00de10 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 shutdown_connections 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f42400a2b80 0x7f42400a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f425c102360 0x7f425c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f425c1079c0 0x7f425c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 --2- 172.21.15.144:0/2797572677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425c1019c0 0x7f425c198290 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 >> 172.21.15.144:0/2797572677 conn(0x7f425c0fd6e0 msgr2=0x7f425c0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 shutdown_connections 2024-09-05T07:48:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:48:57.429+0000 7f4262000640 1 -- 172.21.15.144:0/2797572677 wait complete. 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: Deploying daemon mds.a on smithi144 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:57.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6838/1312798702,v1:172.21.15.144:6839/1312798702] up:boot 2024-09-05T07:48:57.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: fsmap 10 up:standby 2024-09-05T07:48:57.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T07:48:57.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:48:57 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2797572677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:57.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:57.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: Deploying daemon mds.a on smithi144 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6838/1312798702,v1:172.21.15.144:6839/1312798702] up:boot 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: fsmap 10 up:standby 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T07:48:57.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:48:57 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2797572677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:48:58.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:58.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:58.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:48:58.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:48:58.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: Deploying daemon mds.a on smithi144 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6838/1312798702,v1:172.21.15.144:6839/1312798702] up:boot 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: fsmap 10 up:standby 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T07:48:58.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:48:57 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2797572677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:00.291 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 systemd[1]: Starting Ceph mds.a for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:49:00.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:49:00.549 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:00 smithi144 ceph-mon[29535]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:00.549 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 podman[70515]: 2024-09-05 07:49:00.239876664 +0000 UTC m=+0.027270266 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:49:00.549 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 podman[70515]: 2024-09-05 07:49:00.4013152 +0000 UTC m=+0.188708811 container create 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T07:49:00.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:00 smithi175 ceph-mon[34585]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:00 smithi154 ceph-mon[34710]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:00.928 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 podman[70515]: 2024-09-05 07:49:00.663281854 +0000 UTC m=+0.450675456 container init 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 podman[70515]: 2024-09-05 07:49:00.669862313 +0000 UTC m=+0.457255915 container start 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 ceph-mds[70564]: -- 172.21.15.144:0/3975128262 <== mon.0 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f94d04fc20 con 0x55f94d02d400 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: starting mds.a at 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 bash[70515]: 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a 2024-09-05T07:49:01.067 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:49:00 smithi144 systemd[1]: Started Ceph mds.a for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:49:01.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 -- 172.21.15.144:0/585887032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 msgr2=0x7fa94410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:01.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 --2- 172.21.15.144:0/585887032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94410eaa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009ca0 tx=0x7fa93c02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 -- 172.21.15.144:0/585887032 shutdown_connections 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 --2- 172.21.15.144:0/585887032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94410eaa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 --2- 172.21.15.144:0/585887032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa9441067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 --2- 172.21.15.144:0/585887032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa9441021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 -- 172.21.15.144:0/585887032 >> 172.21.15.144:0/585887032 conn(0x7fa9440fd8b0 msgr2=0x7fa9440ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 -- 172.21.15.144:0/585887032 shutdown_connections 2024-09-05T07:49:01.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.517+0000 7fa948e00640 1 -- 172.21.15.144:0/585887032 wait complete. 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.518+0000 7fa948e00640 1 Processor -- start 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.518+0000 7fa948e00640 1 -- start start 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa94419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa944111fd0 con 0x7fa944101df0 2024-09-05T07:49:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa944111e50 con 0x7fa944106f20 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa948e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa944112150 con 0x7fa9441027a0 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa941e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa94419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa942800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa941e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50594/0 (socket says 172.21.15.144:50594) 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa941e00640 1 -- 172.21.15.144:0/60555876 learned_addr learned my addr 172.21.15.144:0/60555876 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 -- 172.21.15.144:0/60555876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 msgr2=0x7fa94419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 -- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 msgr2=0x7fa94419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa93be00640 1 -- 172.21.15.144:0/60555876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94419f570 con 0x7fa9441027a0 2024-09-05T07:49:01.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa942800640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.519+0000 7fa941e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa93be00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa94419ab00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00e9f0 tx=0x7fa92c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00ccc0 con 0x7fa9441027a0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa92c005020 con 0x7fa9441027a0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94419f860 con 0x7fa9441027a0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0049e0 con 0x7fa9441027a0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.520+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9441a7140 con 0x7fa9441027a0 2024-09-05T07:49:01.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.521+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9441021d0 con 0x7fa9441027a0 2024-09-05T07:49:01.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.523+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa92c005560 con 0x7fa9441027a0 2024-09-05T07:49:01.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.524+0000 7fa93aa00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 0x7fa9280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:01.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.524+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fa92c0ceb30 con 0x7fa9441027a0 2024-09-05T07:49:01.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.525+0000 7fa941e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 0x7fa9280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:01.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.525+0000 7fa941e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 0x7fa9280a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa934005fd0 tx=0x7fa93400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:01.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.529+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa92c0051d0 con 0x7fa9441027a0 2024-09-05T07:49:01.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.739+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9441a7470 con 0x7fa9441027a0 2024-09-05T07:49:01.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.740+0000 7fa93aa00640 1 -- 172.21.15.144:0/60555876 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9713 (secure 0 0 0) 0x7fa92c09be90 con 0x7fa9441027a0 2024-09-05T07:49:01.741 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:01.742 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":12,"btime":"2024-09-05T07:49:01:290756+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T07:49:01.742 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 12 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 msgr2=0x7fa9280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 0x7fa9280a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa934005fd0 tx=0x7fa93400b4a0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 msgr2=0x7fa94419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa94419ab00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00e9f0 tx=0x7fa92c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 shutdown_connections 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa9280a2b80 0x7fa9280a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa944106f20 0x7fa94419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9441027a0 0x7fa94419ab00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 --2- 172.21.15.144:0/60555876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa944101df0 0x7fa94419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:01.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 >> 172.21.15.144:0/60555876 conn(0x7fa9440fd8b0 msgr2=0x7fa9440fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:01.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 shutdown_connections 2024-09-05T07:49:01.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:01.743+0000 7fa948e00640 1 -- 172.21.15.144:0/60555876 wait complete. 2024-09-05T07:49:02.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:49:02.063 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: Deploying daemon mds.b on smithi154 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:boot 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: fsmap 11 up:standby 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:49:02.064 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:01 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/60555876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:02.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: Deploying daemon mds.b on smithi154 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:boot 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: fsmap 11 up:standby 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:49:02.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:01 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/60555876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: Deploying daemon mds.b on smithi154 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:boot 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: fsmap 11 up:standby 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:49:02.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:01 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/60555876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:03.134 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:02 smithi154 systemd[1]: Starting Ceph mds.b for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:49:03.134 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 podman[64074]: 2024-09-05 07:49:03.036907941 +0000 UTC m=+0.016337662 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:49:03.400 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 podman[64074]: 2024-09-05 07:49:03.14788403 +0000 UTC m=+0.127313743 container create d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-05T07:49:03.687 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 podman[64074]: 2024-09-05 07:49:03.400765153 +0000 UTC m=+0.380194865 container init d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:49:03.688 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 podman[64074]: 2024-09-05 07:49:03.404050505 +0000 UTC m=+0.383480218 container start d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-05T07:49:03.688 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 ceph-mds[64093]: -- 172.21.15.154:0/442957395 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55730467b860 con 0x557304659400 2024-09-05T07:49:03.688 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: starting mds.b at 2024-09-05T07:49:03.688 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 bash[64074]: d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b 2024-09-05T07:49:03.688 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:03 smithi154 systemd[1]: Started Ceph mds.b for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:49:04.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:49:04.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:04.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:04 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:04.579 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:04.579 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.579 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.579 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:04 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:04.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:04 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:05.219 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:05.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:boot 2024-09-05T07:49:05.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: fsmap 12 up:standby 2024-09-05T07:49:05.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:49:05.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:boot 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: fsmap 12 up:standby 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.570 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:boot 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: fsmap 12 up:standby 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 -- 172.21.15.144:0/1361249141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48074590 msgr2=0x7fdf48074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 --2- 172.21.15.144:0/1361249141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48074590 0x7fdf48074970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009900 tx=0x7fdf3802a480 comp rx=0 tx=0).stop 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 -- 172.21.15.144:0/1361249141 shutdown_connections 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 --2- 172.21.15.144:0/1361249141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48112b90 0x7fdf48114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 --2- 172.21.15.144:0/1361249141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074eb0 0x7fdf48112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:05.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 --2- 172.21.15.144:0/1361249141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48074590 0x7fdf48074970 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.805+0000 7fdf4d200640 1 -- 172.21.15.144:0/1361249141 >> 172.21.15.144:0/1361249141 conn(0x7fdf480fd8c0 msgr2=0x7fdf480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.806+0000 7fdf4d200640 1 -- 172.21.15.144:0/1361249141 shutdown_connections 2024-09-05T07:49:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.806+0000 7fdf4d200640 1 -- 172.21.15.144:0/1361249141 wait complete. 2024-09-05T07:49:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.806+0000 7fdf4d200640 1 Processor -- start 2024-09-05T07:49:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 -- start start 2024-09-05T07:49:05.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 0x7fdf481a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 0x7fdf4819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf48118550 con 0x7fdf48112b90 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf481183d0 con 0x7fdf48074eb0 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf4d200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf481186d0 con 0x7fdf48074590 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf45400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf45e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 0x7fdf481a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf45400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:33428/0 (socket says 172.21.15.144:33428) 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf45400640 1 -- 172.21.15.144:0/562225339 learned_addr learned my addr 172.21.15.144:0/562225339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.807+0000 7fdf46800640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 0x7fdf4819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:05.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 -- 172.21.15.144:0/562225339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 msgr2=0x7fdf481a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 0x7fdf481a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 -- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 msgr2=0x7fdf4819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 0x7fdf4819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 -- 172.21.15.144:0/562225339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4819efd0 con 0x7fdf48074eb0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf46800640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 0x7fdf4819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45e00640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 0x7fdf481a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf45400640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e9f0 tx=0x7fdf3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400cd80 con 0x7fdf48074eb0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf34010910 con 0x7fdf48074eb0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4819f2c0 con 0x7fdf48074eb0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34018990 con 0x7fdf48074eb0 2024-09-05T07:49:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.808+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481ab5b0 con 0x7fdf48074eb0 2024-09-05T07:49:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.809+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48074970 con 0x7fdf48074eb0 2024-09-05T07:49:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.812+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdf34010ac0 con 0x7fdf48074eb0 2024-09-05T07:49:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.813+0000 7fdf3ea00640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 0x7fdf2c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.813+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fdf340cef60 con 0x7fdf48074eb0 2024-09-05T07:49:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.813+0000 7fdf45e00640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 0x7fdf2c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.814+0000 7fdf45e00640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 0x7fdf2c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf4819f9e0 tx=0x7fdf380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:05.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:05.817+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf3409c2c0 con 0x7fdf48074eb0 2024-09-05T07:49:06.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.043+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf4802d7c0 con 0x7fdf48074eb0 2024-09-05T07:49:06.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.044+0000 7fdf3ea00640 1 -- 172.21.15.144:0/562225339 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10542 (secure 0 0 0) 0x7fdf3409bbc0 con 0x7fdf48074eb0 2024-09-05T07:49:06.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:06.046 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":13,"btime":"2024-09-05T07:49:04:302254+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-05T07:49:06.046 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 13 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 msgr2=0x7fdf2c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 0x7fdf2c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf4819f9e0 tx=0x7fdf380058d0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 msgr2=0x7fdf481a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e9f0 tx=0x7fdf3400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 shutdown_connections 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf2c0a2c00 0x7fdf2c0a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf48074eb0 0x7fdf481a4c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf48112b90 0x7fdf4819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 --2- 172.21.15.144:0/562225339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf48074590 0x7fdf481a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:06.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.047+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 >> 172.21.15.144:0/562225339 conn(0x7fdf480fd8c0 msgr2=0x7fdf480ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:06.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.048+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 shutdown_connections 2024-09-05T07:49:06.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:06.048+0000 7fdf4d200640 1 -- 172.21.15.144:0/562225339 wait complete. 2024-09-05T07:49:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:06 smithi154 ceph-mon[34710]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:06.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:06 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/562225339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:06.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:06 smithi144 ceph-mon[29535]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:06.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:06 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/562225339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:06 smithi175 ceph-mon[34585]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:06.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:06 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/562225339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:06.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-05T07:49:07.210 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:07.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:07.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:07 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:07 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:07.705 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.705 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.705 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:07.705 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:07.705 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:07.706 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:07 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:49:08.434 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:08 smithi144 ceph-mon[29535]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:08.434 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.434 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.434 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.434 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:08 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 -- 172.21.15.144:0/279003965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 msgr2=0x7f47f8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 --2- 172.21.15.144:0/279003965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f8110650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009ca0 tx=0x7f47f002a950 comp rx=0 tx=0).stop 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 -- 172.21.15.144:0/279003965 shutdown_connections 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 --2- 172.21.15.144:0/279003965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 0x7f47f810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 --2- 172.21.15.144:0/279003965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f8110650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 --2- 172.21.15.144:0/279003965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 -- 172.21.15.144:0/279003965 >> 172.21.15.144:0/279003965 conn(0x7f47f80fd740 msgr2=0x7f47f80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:08.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 -- 172.21.15.144:0/279003965 shutdown_connections 2024-09-05T07:49:08.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.534+0000 7f47fda00640 1 -- 172.21.15.144:0/279003965 wait complete. 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.535+0000 7f47fda00640 1 Processor -- start 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 -- start start 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 0x7f47f819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8113fb0 con 0x7f47f810e260 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8113e30 con 0x7f47f8074ee0 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fda00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8114130 con 0x7f47f80745c0 2024-09-05T07:49:08.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58562/0 (socket says 172.21.15.144:58562) 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47f7400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 0x7f47f819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.536+0000 7f47fd000640 1 -- 172.21.15.144:0/3142816832 learned_addr learned my addr 172.21.15.144:0/3142816832 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 -- 172.21.15.144:0/3142816832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 msgr2=0x7f47f819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 0x7f47f819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 -- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 msgr2=0x7f47f819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 -- 172.21.15.144:0/3142816832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f819f400 con 0x7f47f80745c0 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47fd000640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f7e00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f819a450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e800e9f0 tx=0x7f47e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.537+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e800ccc0 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.538+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e8010910 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.538+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8018960 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.538+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f819f6f0 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.538+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81a6fd0 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.539+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f80749a0 con 0x7f47f80745c0 2024-09-05T07:49:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.541+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f47e8010ac0 con 0x7f47f80745c0 2024-09-05T07:49:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.542+0000 7f47f4c00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 0x7f47dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.542+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f47e80cefb0 con 0x7f47f80745c0 2024-09-05T07:49:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.542+0000 7f47f7400640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 0x7f47dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.543+0000 7f47f7400640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 0x7f47dc0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47f810f5f0 tx=0x7f47e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.546+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47e809bcc0 con 0x7f47f80745c0 2024-09-05T07:49:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:08 smithi154 ceph-mon[34710]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:08 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.734+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f47f8108e50 con 0x7f47f80745c0 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.735+0000 7f47f4c00640 1 -- 172.21.15.144:0/3142816832 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7f47e809ffc0 con 0x7f47f80745c0 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-05T07:49:08.736 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-05T07:49:08.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:49:08.737 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 msgr2=0x7f47dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 0x7f47dc0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47f810f5f0 tx=0x7f47e4005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 msgr2=0x7f47f819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f819a450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e800e9f0 tx=0x7f47e800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 shutdown_connections 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f47dc0a2b80 0x7f47dc0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47f8074ee0 0x7f47f819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f810e260 0x7f47f819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 --2- 172.21.15.144:0/3142816832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f80745c0 0x7f47f819a450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.737+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 >> 172.21.15.144:0/3142816832 conn(0x7f47f80fd740 msgr2=0x7f47f80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.738+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 shutdown_connections 2024-09-05T07:49:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:08.738+0000 7f47fda00640 1 -- 172.21.15.144:0/3142816832 wait complete. 2024-09-05T07:49:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:08 smithi175 ceph-mon[34585]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:08 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:09.523 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-05T07:49:09.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-05T07:49:09.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:09 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3142816832' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T07:49:09.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:09 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3142816832' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T07:49:09.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:09 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3142816832' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T07:49:09.920 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:10.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 -- 172.21.15.144:0/3721465930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc1049a0 msgr2=0x7fd8bc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:10.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3721465930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc1089f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009860 tx=0x7fd8ac02a340 comp rx=0 tx=0).stop 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 -- 172.21.15.144:0/3721465930 shutdown_connections 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3721465930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc109120 0x7fd8bc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3721465930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc1089f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3721465930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 0x7fd8bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 -- 172.21.15.144:0/3721465930 >> 172.21.15.144:0/3721465930 conn(0x7fd8bc0ffa90 msgr2=0x7fd8bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 -- 172.21.15.144:0/3721465930 shutdown_connections 2024-09-05T07:49:10.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.493+0000 7fd8c4800640 1 -- 172.21.15.144:0/3721465930 wait complete. 2024-09-05T07:49:10.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.494+0000 7fd8c4800640 1 Processor -- start 2024-09-05T07:49:10.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.494+0000 7fd8c4800640 1 -- start start 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 0x7fd8bc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 0x7fd8bc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc114120 con 0x7fd8bc1049a0 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc113fa0 con 0x7fd8bc103ff0 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c4800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc1142a0 con 0x7fd8bc109120 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58584/0 (socket says 172.21.15.144:58584) 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 0x7fd8bc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 -- 172.21.15.144:0/3835946357 learned_addr learned my addr 172.21.15.144:0/3835946357 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1e00640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 0x7fd8bc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:10.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 -- 172.21.15.144:0/3835946357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 msgr2=0x7fd8bc19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 0x7fd8bc19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 -- 172.21.15.144:0/3835946357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 msgr2=0x7fd8bc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.495+0000 7fd8c1400640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 0x7fd8bc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8c1400640 1 -- 172.21.15.144:0/3835946357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc19f650 con 0x7fd8bc1049a0 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8c2800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 0x7fd8bc19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:10.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8c1400640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac035040 tx=0x7fd8ac033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac03f020 con 0x7fd8bc1049a0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8ac032770 con 0x7fd8bc1049a0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac037040 con 0x7fd8bc1049a0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc19f8e0 con 0x7fd8bc1049a0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.496+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc19fd70 con 0x7fd8bc1049a0 2024-09-05T07:49:10.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.498+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc1043d0 con 0x7fd8bc1049a0 2024-09-05T07:49:10.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.500+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd8ac042020 con 0x7fd8bc1049a0 2024-09-05T07:49:10.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.502+0000 7fd8b6a00640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 0x7fd8a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:10.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.502+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fd8ac0eede0 con 0x7fd8bc1049a0 2024-09-05T07:49:10.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.502+0000 7fd8c1e00640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 0x7fd8a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:10.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.503+0000 7fd8c1e00640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 0x7fd8a40a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009530 tx=0x7fd8b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:10.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.504+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8ac049030 con 0x7fd8bc1049a0 2024-09-05T07:49:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:10 smithi154 ceph-mon[34710]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:10 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:10.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:10.737+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd8bc10c390 con 0x7fd8bc1049a0 2024-09-05T07:49:10.739 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:10 smithi144 ceph-mon[29535]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:10.740 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:10.740 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:10 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:10 smithi175 ceph-mon[34585]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:10 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.604+0000 7fd8b6a00640 1 -- 172.21.15.144:0/3835946357 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7fd8ac0bc140 con 0x7fd8bc1049a0 2024-09-05T07:49:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 msgr2=0x7fd8a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 0x7fd8a40a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009530 tx=0x7fd8b0009260 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 msgr2=0x7fd8bc19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac035040 tx=0x7fd8ac033d90 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 shutdown_connections 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8a40a2b80 0x7fd8a40a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8bc109120 0x7fd8bc19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc1049a0 0x7fd8bc19abe0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 --2- 172.21.15.144:0/3835946357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc103ff0 0x7fd8bc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.607+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 >> 172.21.15.144:0/3835946357 conn(0x7fd8bc0ffa90 msgr2=0x7fd8bc100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.608+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 shutdown_connections 2024-09-05T07:49:11.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:11.608+0000 7fd8c4800640 1 -- 172.21.15.144:0/3835946357 wait complete. 2024-09-05T07:49:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:11 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T07:49:11.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:11.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:11.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:11.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:11 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T07:49:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:49:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:49:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:49:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:11 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T07:49:12.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-05T07:49:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:12 smithi144 ceph-mon[29535]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:12 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T07:49:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:12 smithi144 ceph-mon[29535]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T07:49:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:12 smithi154 ceph-mon[34710]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:12 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T07:49:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:12 smithi154 ceph-mon[34710]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T07:49:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:12 smithi175 ceph-mon[34585]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:12 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3835946357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T07:49:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:12 smithi175 ceph-mon[34585]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 -- 172.21.15.144:0/1678833875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 msgr2=0x7fdf301089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 --2- 172.21.15.144:0/1678833875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf301089f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009900 tx=0x7fdf1c02a410 comp rx=0 tx=0).stop 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 -- 172.21.15.144:0/1678833875 shutdown_connections 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 --2- 172.21.15.144:0/1678833875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30109120 0x7fdf30110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 --2- 172.21.15.144:0/1678833875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf301089f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 --2- 172.21.15.144:0/1678833875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30103ff0 0x7fdf301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 -- 172.21.15.144:0/1678833875 >> 172.21.15.144:0/1678833875 conn(0x7fdf300ffa90 msgr2=0x7fdf30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 -- 172.21.15.144:0/1678833875 shutdown_connections 2024-09-05T07:49:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.233+0000 7fdf34a00640 1 -- 172.21.15.144:0/1678833875 wait complete. 2024-09-05T07:49:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.234+0000 7fdf34a00640 1 Processor -- start 2024-09-05T07:49:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.234+0000 7fdf34a00640 1 -- start start 2024-09-05T07:49:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 0x7fdf3019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114190 con 0x7fdf301049a0 2024-09-05T07:49:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114010 con 0x7fdf30109120 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf34a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114310 con 0x7fdf30103ff0 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:54068/0 (socket says 172.21.15.144:54068) 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 -- 172.21.15.144:0/219108824 learned_addr learned my addr 172.21.15.144:0/219108824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2e800640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 0x7fdf3019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 -- 172.21.15.144:0/219108824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 msgr2=0x7fdf3019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 0x7fdf3019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 -- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 msgr2=0x7fdf3019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2de00640 1 -- 172.21.15.144:0/219108824 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3019f5a0 con 0x7fdf30103ff0 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.235+0000 7fdf2e800640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 0x7fdf3019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:49:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf2de00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000e9f0 tx=0x7fdf2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000cd80 con 0x7fdf30103ff0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3019f890 con 0x7fdf30103ff0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf20010910 con 0x7fdf30103ff0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200188f0 con 0x7fdf30103ff0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.236+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf301a7170 con 0x7fdf30103ff0 2024-09-05T07:49:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.237+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf301043d0 con 0x7fdf30103ff0 2024-09-05T07:49:13.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.239+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdf20010ac0 con 0x7fdf30103ff0 2024-09-05T07:49:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.241+0000 7fdf26a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 0x7fdf140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.241+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7497+0+0 (secure 0 0 0) 0x7fdf200cf5f0 con 0x7fdf30103ff0 2024-09-05T07:49:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.241+0000 7fdf2d400640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 0x7fdf140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.241+0000 7fdf2d400640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 0x7fdf140a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c000c00 tx=0x7fdf1c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.243+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf2009c7e0 con 0x7fdf30103ff0 2024-09-05T07:49:13.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.418+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdf301a7410 con 0x7fdf30103ff0 2024-09-05T07:49:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.932+0000 7fdf26a00640 1 -- 172.21.15.144:0/219108824 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7fdf2009c0e0 con 0x7fdf30103ff0 2024-09-05T07:49:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-05T07:49:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.937+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 msgr2=0x7fdf140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.937+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 0x7fdf140a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c000c00 tx=0x7fdf1c005b50 comp rx=0 tx=0).stop 2024-09-05T07:49:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.937+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 msgr2=0x7fdf3019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.937+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000e9f0 tx=0x7fdf2000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 shutdown_connections 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fdf140a2b80 0x7fdf140a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf30109120 0x7fdf3019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 --2- 172.21.15.144:0/219108824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a5f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.938+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 >> 172.21.15.144:0/219108824 conn(0x7fdf300ffa90 msgr2=0x7fdf30100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.939+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 shutdown_connections 2024-09-05T07:49:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:13.939+0000 7fdf34a00640 1 -- 172.21.15.144:0/219108824 wait complete. 2024-09-05T07:49:14.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:13 smithi154 ceph-mon[34710]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T07:49:14.306 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:13 smithi144 ceph-mon[29535]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T07:49:14.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:13 smithi175 ceph-mon[34585]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T07:49:14.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-05T07:49:15.070 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:15.210 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: pgmap v284: 33 pgs: 4 active+clean, 15 creating+peering, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:15.210 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/219108824' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.210 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.210 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T07:49:15.211 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T07:49:15.211 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:14 smithi144 ceph-mon[29535]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T07:49:15.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: pgmap v284: 33 pgs: 4 active+clean, 15 creating+peering, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:15.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/219108824' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T07:49:15.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T07:49:15.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:14 smithi175 ceph-mon[34585]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T07:49:15.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: pgmap v284: 33 pgs: 4 active+clean, 15 creating+peering, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:15.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/219108824' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T07:49:15.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T07:49:15.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T07:49:15.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:14 smithi154 ceph-mon[34710]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T07:49:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 -- 172.21.15.144:0/1529117162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 msgr2=0x7f08f410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 --2- 172.21.15.144:0/1529117162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f410b9a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009900 tx=0x7f08e002a480 comp rx=0 tx=0).stop 2024-09-05T07:49:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 -- 172.21.15.144:0/1529117162 shutdown_connections 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 --2- 172.21.15.144:0/1529117162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f410bfc0 0x7f08f410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 --2- 172.21.15.144:0/1529117162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f410b9a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 --2- 172.21.15.144:0/1529117162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f4102b90 0x7f08f4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 -- 172.21.15.144:0/1529117162 >> 172.21.15.144:0/1529117162 conn(0x7f08f40fc630 msgr2=0x7f08f40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 -- 172.21.15.144:0/1529117162 shutdown_connections 2024-09-05T07:49:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.621+0000 7f08f9800640 1 -- 172.21.15.144:0/1529117162 wait complete. 2024-09-05T07:49:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.622+0000 7f08f9800640 1 Processor -- start 2024-09-05T07:49:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.622+0000 7f08f9800640 1 -- start start 2024-09-05T07:49:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.622+0000 7f08f9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 0x7f08f419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.622+0000 7f08f9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f9800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f410bfc0 0x7f08f419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4111e10 con 0x7f08f41034b0 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f9800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4111c90 con 0x7f08f410bfc0 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4111f90 con 0x7f08f4102b90 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52642/0 (socket says 172.21.15.144:52642) 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3400640 1 -- 172.21.15.144:0/1240660505 learned_addr learned my addr 172.21.15.144:0/1240660505 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 0x7f08f419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f8e00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f410bfc0 0x7f08f419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 -- 172.21.15.144:0/1240660505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f410bfc0 msgr2=0x7f08f419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f410bfc0 0x7f08f419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 -- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 msgr2=0x7f08f419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.623+0000 7f08f3e00640 1 -- 172.21.15.144:0/1240660505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f419f460 con 0x7f08f4102b90 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f3e00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 0x7f08f419a4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08e400e9f0 tx=0x7f08e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e400ccc0 con 0x7f08f4102b90 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08e4010910 con 0x7f08f4102b90 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f419f750 con 0x7f08f4102b90 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4018960 con 0x7f08f4102b90 2024-09-05T07:49:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.624+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f41a7030 con 0x7f08f4102b90 2024-09-05T07:49:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.625+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f4102f70 con 0x7f08f4102b90 2024-09-05T07:49:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.627+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f08e4010ac0 con 0x7f08f4102b90 2024-09-05T07:49:15.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.628+0000 7f08f0c00640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 0x7f08d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:15.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.628+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7f08e40cf780 con 0x7f08f4102b90 2024-09-05T07:49:15.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.629+0000 7f08f3400640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 0x7f08d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:15.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.629+0000 7f08f3400640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 0x7f08d80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08e00096c0 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:15.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.630+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08e409c1a0 con 0x7f08f4102b90 2024-09-05T07:49:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.845+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f08f41a72d0 con 0x7f08f4102b90 2024-09-05T07:49:15.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.951+0000 7f08f0c00640 1 -- 172.21.15.144:0/1240660505 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f08e40a04a0 con 0x7f08f4102b90 2024-09-05T07:49:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 2 and data pool 3 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 msgr2=0x7f08d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 0x7f08d80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08e00096c0 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 msgr2=0x7f08f419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 0x7f08f419a4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08e400e9f0 tx=0x7f08e400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 shutdown_connections 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08d80a2b80 0x7f08d80a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f410bfc0 0x7f08f419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f41034b0 0x7f08f419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 --2- 172.21.15.144:0/1240660505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f4102b90 0x7f08f419a4b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:15.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 >> 172.21.15.144:0/1240660505 conn(0x7f08f40fc630 msgr2=0x7f08f410d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:15.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 shutdown_connections 2024-09-05T07:49:15.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:15.954+0000 7f08f9800640 1 -- 172.21.15.144:0/1240660505 wait complete. 2024-09-05T07:49:16.239 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:15 smithi175 ceph-mon[34585]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T07:49:16.239 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:15 smithi175 ceph-mon[34585]: pgmap v287: 97 pgs: 20 active+clean, 37 creating+peering, 40 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:16.239 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:15 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1240660505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.239 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:15 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.239 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:15 smithi175 ceph-mon[34585]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T07:49:16.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:15 smithi144 ceph-mon[29535]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T07:49:16.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:15 smithi144 ceph-mon[29535]: pgmap v287: 97 pgs: 20 active+clean, 37 creating+peering, 40 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:16.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:15 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1240660505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:15 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:15 smithi144 ceph-mon[29535]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T07:49:16.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:15 smithi154 ceph-mon[34710]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T07:49:16.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:15 smithi154 ceph-mon[34710]: pgmap v287: 97 pgs: 20 active+clean, 37 creating+peering, 40 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:49:16.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:15 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1240660505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:15 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T07:49:16.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:15 smithi154 ceph-mon[34710]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T07:49:16.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:49:17.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:16 smithi144 ceph-mon[29535]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T07:49:17.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:16 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T07:49:17.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:16 smithi144 ceph-mon[29535]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T07:49:17.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:16 smithi144 ceph-mon[29535]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T07:49:17.147 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:17.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:16 smithi175 ceph-mon[34585]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T07:49:17.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:16 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T07:49:17.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:16 smithi175 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T07:49:17.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:16 smithi175 ceph-mon[34585]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T07:49:17.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:16 smithi154 ceph-mon[34710]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T07:49:17.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:16 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T07:49:17.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:16 smithi154 ceph-mon[34710]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T07:49:17.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:16 smithi154 ceph-mon[34710]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T07:49:17.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 -- 172.21.15.144:0/1617008014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798103e30 msgr2=0x7f6798104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:17.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 --2- 172.21.15.144:0/1617008014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798103e30 0x7f6798104210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f678c009900 tx=0x7f678c02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 -- 172.21.15.144:0/1617008014 shutdown_connections 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 --2- 172.21.15.144:0/1617008014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798108f60 0x7f6798110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 --2- 172.21.15.144:0/1617008014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 0x7f6798108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 --2- 172.21.15.144:0/1617008014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798103e30 0x7f6798104210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 -- 172.21.15.144:0/1617008014 >> 172.21.15.144:0/1617008014 conn(0x7f67980ff910 msgr2=0x7f6798101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 -- 172.21.15.144:0/1617008014 shutdown_connections 2024-09-05T07:49:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.689+0000 7f679f200640 1 -- 172.21.15.144:0/1617008014 wait complete. 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.690+0000 7f679f200640 1 Processor -- start 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.690+0000 7f679f200640 1 -- start start 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 0x7f679819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 0x7f679819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 0x7f679819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6798113f80 con 0x7f6798103e30 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6798113e00 con 0x7f6798108f60 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6798114100 con 0x7f67981047e0 2024-09-05T07:49:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 0x7f679819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 0x7f679819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 0x7f679819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 0x7f679819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52668/0 (socket says 172.21.15.144:52668) 2024-09-05T07:49:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.691+0000 7f679de00640 1 -- 172.21.15.144:0/2455872692 learned_addr learned my addr 172.21.15.144:0/2455872692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 -- 172.21.15.144:0/2455872692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 msgr2=0x7f679819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 0x7f679819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 -- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 msgr2=0x7f679819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 0x7f679819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 -- 172.21.15.144:0/2455872692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679819f410 con 0x7f6798108f60 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679e800640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 0x7f679819ed30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6794009fd0 tx=0x7f679400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679400ce20 con 0x7f6798108f60 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6794005020 con 0x7f6798108f60 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679819f700 con 0x7f6798108f60 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794010720 con 0x7f6798108f60 2024-09-05T07:49:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.692+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981a6fe0 con 0x7f6798108f60 2024-09-05T07:49:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.694+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6798105310 con 0x7f6798108f60 2024-09-05T07:49:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.695+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6794005540 con 0x7f6798108f60 2024-09-05T07:49:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.697+0000 7f6792a00640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 0x7f67800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.697+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f67940cf730 con 0x7f6798108f60 2024-09-05T07:49:17.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.697+0000 7f679de00640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 0x7f67800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:17.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.698+0000 7f679de00640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 0x7f67800a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f678c0096c0 tx=0x7f678c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:17.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.699+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f679409c740 con 0x7f6798108f60 2024-09-05T07:49:17.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.882+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6798104210 con 0x7f6798108f60 2024-09-05T07:49:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.884+0000 7f6792a00640 1 -- 172.21.15.144:0/2455872692 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22370 (secure 0 0 0) 0x7f6798104210 con 0x7f6798108f60 2024-09-05T07:49:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:17.886 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:49:15.848324+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:49:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 msgr2=0x7f67800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 0x7f67800a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f678c0096c0 tx=0x7f678c005a20 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 msgr2=0x7f679819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 0x7f679819ed30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6794009fd0 tx=0x7f679400ef10 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 shutdown_connections 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f67800a2b80 0x7f67800a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6798108f60 0x7f679819ed30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67981047e0 0x7f679819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 --2- 172.21.15.144:0/2455872692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6798103e30 0x7f679819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 >> 172.21.15.144:0/2455872692 conn(0x7f67980ff910 msgr2=0x7f6798100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 shutdown_connections 2024-09-05T07:49:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:17.887+0000 7f679f200640 1 -- 172.21.15.144:0/2455872692 wait complete. 2024-09-05T07:49:18.245 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:active 2024-09-05T07:49:18.245 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:17 smithi144 ceph-mon[29535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.245 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:17 smithi144 ceph-mon[29535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.245 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:17 smithi144 ceph-mon[29535]: pgmap v289: 97 pgs: 30 active+clean, 34 creating+peering, 33 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 1 op/s 2024-09-05T07:49:18.245 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2455872692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:18.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:active 2024-09-05T07:49:18.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:17 smithi175 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:17 smithi175 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:17 smithi175 ceph-mon[34585]: pgmap v289: 97 pgs: 30 active+clean, 34 creating+peering, 33 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 1 op/s 2024-09-05T07:49:18.338 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2455872692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:18.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] up:active 2024-09-05T07:49:18.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:17 smithi154 ceph-mon[34710]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:17 smithi154 ceph-mon[34710]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:18.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:17 smithi154 ceph-mon[34710]: pgmap v289: 97 pgs: 30 active+clean, 34 creating+peering, 33 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 1 op/s 2024-09-05T07:49:18.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2455872692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:18.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:49:19.121 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:19.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:18 smithi144 ceph-mon[29535]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T07:49:19.260 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:18 smithi144 ceph-mon[29535]: Cluster is now healthy 2024-09-05T07:49:19.315 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:18 smithi154 ceph-mon[34710]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T07:49:19.316 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:18 smithi154 ceph-mon[34710]: Cluster is now healthy 2024-09-05T07:49:19.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:18 smithi175 ceph-mon[34585]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T07:49:19.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:18 smithi175 ceph-mon[34585]: Cluster is now healthy 2024-09-05T07:49:19.687 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: 2024-09-05T07:49:19.314+0000 7f079f0ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 -- 172.21.15.144:0/234511585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8106f10 msgr2=0x7f9da810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 --2- 172.21.15.144:0/234511585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8106f10 0x7f9da810ea90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009be0 tx=0x7f9da402a6c0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 -- 172.21.15.144:0/234511585 shutdown_connections 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 --2- 172.21.15.144:0/234511585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8102790 0x7f9da81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 --2- 172.21.15.144:0/234511585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8106f10 0x7f9da810ea90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 --2- 172.21.15.144:0/234511585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8101de0 0x7f9da81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 -- 172.21.15.144:0/234511585 >> 172.21.15.144:0/234511585 conn(0x7f9da80fd8c0 msgr2=0x7f9da80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 -- 172.21.15.144:0/234511585 shutdown_connections 2024-09-05T07:49:19.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.695+0000 7f9db0800640 1 -- 172.21.15.144:0/234511585 wait complete. 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 Processor -- start 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 -- start start 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 0x7f9da8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 0x7f9da819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8111f70 con 0x7f9da8102790 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8111df0 con 0x7f9da8101de0 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.696+0000 7f9db0800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9da81120f0 con 0x7f9da8106f10 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 0x7f9da8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:33910/0 (socket says 172.21.15.144:33910) 2024-09-05T07:49:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dade00640 1 -- 172.21.15.144:0/1974662185 learned_addr learned my addr 172.21.15.144:0/1974662185 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dae800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 0x7f9da819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 -- 172.21.15.144:0/1974662185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 msgr2=0x7f9da819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 0x7f9da819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 -- 172.21.15.144:0/1974662185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 msgr2=0x7f9da8198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dad400640 1 -- 172.21.15.144:0/1974662185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da819d3e0 con 0x7f9da8102790 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dae800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 0x7f9da819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.697+0000 7f9dade00640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9dad400640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 0x7f9da8198970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e790 tx=0x7f9d9800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800eea0 con 0x7f9da8102790 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da819d6d0 con 0x7f9da8102790 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9800ccc0 con 0x7f9da8102790 2024-09-05T07:49:19.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98018760 con 0x7f9da8102790 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.698+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da81a4fb0 con 0x7f9da8102790 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.699+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da81021c0 con 0x7f9da8102790 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.702+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9d98010430 con 0x7f9da8102790 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.703+0000 7f9da2a00640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 0x7f9d900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.703+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f9d980cf540 con 0x7f9da8102790 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.703+0000 7f9dade00640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 0x7f9d900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.704+0000 7f9dade00640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 0x7f9d900a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c011500 tx=0x7f9d9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.705+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d9809bf00 con 0x7f9da8102790 2024-09-05T07:49:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.883+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9da810a180 con 0x7f9da8102790 2024-09-05T07:49:19.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.884+0000 7f9da2a00640 1 -- 172.21.15.144:0/1974662185 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22370 (secure 0 0 0) 0x7f9d980a0200 con 0x7f9da8102790 2024-09-05T07:49:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:19.886 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:49:15.848324+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:49:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 msgr2=0x7f9d900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 0x7f9d900a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c011500 tx=0x7f9d9c005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 msgr2=0x7f9da8198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 0x7f9da8198970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e790 tx=0x7f9d9800ec50 comp rx=0 tx=0).stop 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 shutdown_connections 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9d900a2b80 0x7f9d900a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9da8106f10 0x7f9da819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9da8102790 0x7f9da8198970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 --2- 172.21.15.144:0/1974662185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da8101de0 0x7f9da8198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.887+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 >> 172.21.15.144:0/1974662185 conn(0x7f9da80fd8c0 msgr2=0x7f9da80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.888+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 shutdown_connections 2024-09-05T07:49:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:19.888+0000 7f9db0800640 1 -- 172.21.15.144:0/1974662185 wait complete. 2024-09-05T07:49:20.287 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:19 smithi144 ceph-mon[29535]: pgmap v290: 97 pgs: 75 active+clean, 22 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-05T07:49:20.287 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:19 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1974662185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:20.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:19 smithi175 ceph-mon[34585]: pgmap v290: 97 pgs: 75 active+clean, 22 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-05T07:49:20.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:19 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1974662185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:20.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:19 smithi154 ceph-mon[34710]: pgmap v290: 97 pgs: 75 active+clean, 22 creating+peering; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-05T07:49:20.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:19 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1974662185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:20.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-05T07:49:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 -- 172.21.15.144:0/1470870797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58112870 msgr2=0x7fab58114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 --2- 172.21.15.144:0/1470870797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58112870 0x7fab58114c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab50009ca0 tx=0x7fab5002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 -- 172.21.15.144:0/1470870797 shutdown_connections 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 --2- 172.21.15.144:0/1470870797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58077040 0x7fab58112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 --2- 172.21.15.144:0/1470870797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58112870 0x7fab58114c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 --2- 172.21.15.144:0/1470870797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab58076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 -- 172.21.15.144:0/1470870797 >> 172.21.15.144:0/1470870797 conn(0x7fab580ff8d0 msgr2=0x7fab58101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 -- 172.21.15.144:0/1470870797 shutdown_connections 2024-09-05T07:49:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.725+0000 7fab5de00640 1 -- 172.21.15.144:0/1470870797 wait complete. 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.726+0000 7fab5de00640 1 Processor -- start 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.726+0000 7fab5de00640 1 -- start start 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab581a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 0x7fab581a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58112870 0x7fab5819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab58118400 con 0x7fab58077040 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab58118280 con 0x7fab58112870 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5de00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab58118580 con 0x7fab58076720 2024-09-05T07:49:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 0x7fab581a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 0x7fab581a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52700/0 (socket says 172.21.15.144:52700) 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab57e00640 1 -- 172.21.15.144:0/1924093397 learned_addr learned my addr 172.21.15.144:0/1924093397 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5ca00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab581a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5d400640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58112870 0x7fab5819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5ca00640 1 -- 172.21.15.144:0/1924093397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58112870 msgr2=0x7fab5819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5ca00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58112870 0x7fab5819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5ca00640 1 -- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 msgr2=0x7fab581a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.727+0000 7fab5ca00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 0x7fab581a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab5ca00640 1 -- 172.21.15.144:0/1924093397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5819ef20 con 0x7fab58076720 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab5ca00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab581a45e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4c005fd0 tx=0x7fab4c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c009c30 con 0x7fab58076720 2024-09-05T07:49:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5819f210 con 0x7fab58076720 2024-09-05T07:49:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab4c009dd0 con 0x7fab58076720 2024-09-05T07:49:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c010460 con 0x7fab58076720 2024-09-05T07:49:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.728+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab581ab560 con 0x7fab58076720 2024-09-05T07:49:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.729+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5819f580 con 0x7fab58076720 2024-09-05T07:49:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.731+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fab4c003ef0 con 0x7fab58076720 2024-09-05T07:49:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.732+0000 7fab55600640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 0x7fab400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.733+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fab4c0cea70 con 0x7fab58076720 2024-09-05T07:49:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.733+0000 7fab57e00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 0x7fab400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:21.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.733+0000 7fab57e00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 0x7fab400a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab5819ff00 tx=0x7fab44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:21.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.735+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab4c017020 con 0x7fab58076720 2024-09-05T07:49:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:21.947+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fab58077e60 con 0x7fab58076720 2024-09-05T07:49:22.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.306+0000 7fab55600640 1 -- 172.21.15.144:0/1924093397 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fab4c09b430 con 0x7fab58076720 2024-09-05T07:49:22.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 msgr2=0x7fab400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:22.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 0x7fab400a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab5819ff00 tx=0x7fab44005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:22.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 msgr2=0x7fab581a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:22.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab581a45e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4c005fd0 tx=0x7fab4c00dde0 comp rx=0 tx=0).stop 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 shutdown_connections 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab400a2b80 0x7fab400a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab58112870 0x7fab5819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab58077040 0x7fab581a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 --2- 172.21.15.144:0/1924093397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab58076720 0x7fab581a45e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.308+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 >> 172.21.15.144:0/1924093397 conn(0x7fab580ff8d0 msgr2=0x7fab58101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.309+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 shutdown_connections 2024-09-05T07:49:22.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:22.309+0000 7fab5de00640 1 -- 172.21.15.144:0/1924093397 wait complete. 2024-09-05T07:49:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:22 smithi144 ceph-mon[29535]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T07:49:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:22 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1924093397' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:22.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:22 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:22 smithi175 ceph-mon[34585]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T07:49:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:22 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1924093397' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:22 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:22 smithi154 ceph-mon[34710]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-05T07:49:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:22 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1924093397' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:22 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T07:49:23.036 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-05T07:49:23.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-05T07:49:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:23.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:23 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T07:49:23.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:23 smithi144 ceph-mon[29535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:23.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:23 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T07:49:23.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:23 smithi175 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:23.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:23 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T07:49:23.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:23 smithi154 ceph-mon[34710]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 -- 172.21.15.144:0/1943102396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c106b80 msgr2=0x7f4e1c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 --2- 172.21.15.144:0/1943102396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c106b80 0x7f4e1c106f60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009900 tx=0x7f4e0c02a410 comp rx=0 tx=0).stop 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 -- 172.21.15.144:0/1943102396 shutdown_connections 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 --2- 172.21.15.144:0/1943102396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 --2- 172.21.15.144:0/1943102396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 0x7f4e1c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 --2- 172.21.15.144:0/1943102396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c106b80 0x7f4e1c106f60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 -- 172.21.15.144:0/1943102396 >> 172.21.15.144:0/1943102396 conn(0x7f4e1c0fba90 msgr2=0x7f4e1c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 -- 172.21.15.144:0/1943102396 shutdown_connections 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.015+0000 7f4e23800640 1 -- 172.21.15.144:0/1943102396 wait complete. 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.016+0000 7f4e23800640 1 Processor -- start 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.016+0000 7f4e23800640 1 -- start start 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 0x7f4e1c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c106b80 0x7f4e1c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c111fa0 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c111e20 con 0x7f4e1c106b80 2024-09-05T07:49:24.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e23800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c112120 con 0x7f4e1c1005a0 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e20e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e20e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52120/0 (socket says 172.21.15.144:52120) 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e20e00640 1 -- 172.21.15.144:0/3550737968 learned_addr learned my addr 172.21.15.144:0/3550737968 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e13e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 0x7f4e1c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.017+0000 7f4e21800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c106b80 0x7f4e1c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 -- 172.21.15.144:0/3550737968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 msgr2=0x7f4e1c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 0x7f4e1c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 -- 172.21.15.144:0/3550737968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c106b80 msgr2=0x7f4e1c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c106b80 0x7f4e1c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 -- 172.21.15.144:0/3550737968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c19f570 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e20e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c006010 tx=0x7f4e0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c03f070 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e0c031c30 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1c19f800 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c035030 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.018+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1c1a7140 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.019+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1c101080 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.021+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4e0c042070 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.023+0000 7f4e1a000640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 0x7f4e000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:24.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.023+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f4e0c0ef5e0 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.024+0000 7f4e13e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 0x7f4e000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:24.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.024+0000 7f4e13e00640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 0x7f4e000a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c10eed0 tx=0x7f4e04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:24.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.027+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e0c0bbfa0 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.234+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f4e1c1a7310 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.309+0000 7f4e1a000640 1 -- 172.21.15.144:0/3550737968 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f4e0c0c02a0 con 0x7f4e1c0ffc00 2024-09-05T07:49:24.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 msgr2=0x7f4e000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 0x7f4e000a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c10eed0 tx=0x7f4e04005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 msgr2=0x7f4e1c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c006010 tx=0x7f4e0c003c10 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 shutdown_connections 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4e000a2b80 0x7f4e000a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1c106b80 0x7f4e1c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1c1005a0 0x7f4e1c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 --2- 172.21.15.144:0/3550737968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1c0ffc00 0x7f4e1c19a5c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 >> 172.21.15.144:0/3550737968 conn(0x7f4e1c0fba90 msgr2=0x7f4e1c0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 shutdown_connections 2024-09-05T07:49:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:24.312+0000 7f4e23800640 1 -- 172.21.15.144:0/3550737968 wait complete. 2024-09-05T07:49:24.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:24 smithi144 ceph-mon[29535]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:24.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:24 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T07:49:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:24 smithi175 ceph-mon[34585]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:24 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T07:49:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:24 smithi154 ceph-mon[34710]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:24 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T07:49:25.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-05T07:49:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:25.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T07:49:25.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T07:49:25.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T07:49:25.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:25.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T07:49:25.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:25 smithi144 ceph-mon[29535]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T07:49:25.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:25 smithi175 ceph-mon[34585]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3550737968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T07:49:25.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:25 smithi154 ceph-mon[34710]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T07:49:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 -- 172.21.15.144:0/3149985032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 msgr2=0x7f8188110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 --2- 172.21.15.144:0/3149985032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f8188110ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8180009ca0 tx=0x7f818002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 -- 172.21.15.144:0/3149985032 shutdown_connections 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 --2- 172.21.15.144:0/3149985032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f8188110ae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 --2- 172.21.15.144:0/3149985032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81881047e0 0x7f8188108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 --2- 172.21.15.144:0/3149985032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8188103e30 0x7f8188104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 -- 172.21.15.144:0/3149985032 >> 172.21.15.144:0/3149985032 conn(0x7f81880ff8d0 msgr2=0x7f8188101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 -- 172.21.15.144:0/3149985032 shutdown_connections 2024-09-05T07:49:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.143+0000 7f8187e00640 1 -- 172.21.15.144:0/3149985032 wait complete. 2024-09-05T07:49:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.144+0000 7f8187e00640 1 Processor -- start 2024-09-05T07:49:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 -- start start 2024-09-05T07:49:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8188103e30 0x7f818819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881047e0 0x7f818819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8188113fc0 con 0x7f8188108f60 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8188113e40 con 0x7f81881047e0 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8188114140 con 0x7f8188103e30 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52138/0 (socket says 172.21.15.144:52138) 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8187400640 1 -- 172.21.15.144:0/1508034974 learned_addr learned my addr 172.21.15.144:0/1508034974 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f817e000640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881047e0 0x7f818819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.145+0000 7f8186a00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8188103e30 0x7f818819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 -- 172.21.15.144:0/1508034974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8188103e30 msgr2=0x7f818819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8188103e30 0x7f818819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 -- 172.21.15.144:0/1508034974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881047e0 msgr2=0x7f818819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881047e0 0x7f818819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 -- 172.21.15.144:0/1508034974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818819f3d0 con 0x7f8188108f60 2024-09-05T07:49:26.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187400640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8180031a20 tx=0x7f8180031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:26.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180003b70 con 0x7f8188108f60 2024-09-05T07:49:26.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8180003d10 con 0x7f8188108f60 2024-09-05T07:49:26.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818819f660 con 0x7f8188108f60 2024-09-05T07:49:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.146+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818002fc40 con 0x7f8188108f60 2024-09-05T07:49:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.147+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881a6fa0 con 0x7f8188108f60 2024-09-05T07:49:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.148+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8188104210 con 0x7f8188108f60 2024-09-05T07:49:26.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.149+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8180004050 con 0x7f8188108f60 2024-09-05T07:49:26.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.151+0000 7f817fe00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 0x7f816c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:26.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.151+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f81800f0080 con 0x7f8188108f60 2024-09-05T07:49:26.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.151+0000 7f8186a00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 0x7f816c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:26.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.151+0000 7f8186a00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 0x7f816c0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8178009bd0 tx=0x7f8178005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.155+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81800bd120 con 0x7f8188108f60 2024-09-05T07:49:26.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:26.374+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f818810c140 con 0x7f8188108f60 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:active 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:creating} 9 up:standby 2024-09-05T07:49:26.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:26 smithi175 ceph-mon[34585]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-09-05T07:49:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:active 2024-09-05T07:49:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T07:49:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T07:49:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:creating} 9 up:standby 2024-09-05T07:49:26.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:26 smithi154 ceph-mon[34710]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-09-05T07:49:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T07:49:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] up:active 2024-09-05T07:49:26.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T07:49:26.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T07:49:26.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:creating} 9 up:standby 2024-09-05T07:49:26.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:26 smithi144 ceph-mon[29535]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-09-05T07:49:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.338+0000 7f817fe00640 1 -- 172.21.15.144:0/1508034974 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f81800bca20 con 0x7f8188108f60 2024-09-05T07:49:27.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.341+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 msgr2=0x7f816c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.341+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 0x7f816c0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8178009bd0 tx=0x7f8178005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.341+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 msgr2=0x7f818819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.341+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8180031a20 tx=0x7f8180031a50 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 shutdown_connections 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f816c0a2b80 0x7f816c0a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881047e0 0x7f818819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8188108f60 0x7f818819ecf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 --2- 172.21.15.144:0/1508034974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8188103e30 0x7f818819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 >> 172.21.15.144:0/1508034974 conn(0x7f81880ff8d0 msgr2=0x7f8188100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 shutdown_connections 2024-09-05T07:49:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:27.342+0000 7f8187e00640 1 -- 172.21.15.144:0/1508034974 wait complete. 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:active 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:active} 9 up:standby 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:creating} 8 up:standby 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T07:49:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:27 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:active 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:active} 9 up:standby 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:creating} 8 up:standby 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T07:49:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:27 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] up:active 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=a=up:active} 9 up:standby 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:creating} 8 up:standby 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T07:49:27.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:27 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T07:49:28.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-05T07:49:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:active 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: Cluster is now healthy 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:active} 8 up:standby 2024-09-05T07:49:28.599 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-05T07:49:28.600 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:28 smithi144 ceph-mon[29535]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:active 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T07:49:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: Cluster is now healthy 2024-09-05T07:49:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:active} 8 up:standby 2024-09-05T07:49:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-05T07:49:28.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:28 smithi154 ceph-mon[34710]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-05T07:49:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-05T07:49:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1508034974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] up:active 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: Cluster is now healthy 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=a=up:active,3=c=up:active} 8 up:standby 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-05T07:49:28.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:28 smithi175 ceph-mon[34585]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 -- 172.21.15.144:0/2279633995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 msgr2=0x7f7a741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 --2- 172.21.15.144:0/2279633995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a741021c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009900 tx=0x7f7a6402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 -- 172.21.15.144:0/2279633995 shutdown_connections 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 --2- 172.21.15.144:0/2279633995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74106f10 0x7f7a7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 --2- 172.21.15.144:0/2279633995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74102790 0x7f7a741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 --2- 172.21.15.144:0/2279633995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a741021c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 -- 172.21.15.144:0/2279633995 >> 172.21.15.144:0/2279633995 conn(0x7f7a740fd8c0 msgr2=0x7f7a740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 -- 172.21.15.144:0/2279633995 shutdown_connections 2024-09-05T07:49:29.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.027+0000 7f7a79800640 1 -- 172.21.15.144:0/2279633995 wait complete. 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 Processor -- start 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 -- start start 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 0x7f7a74198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74106f10 0x7f7a7419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74111fc0 con 0x7f7a74101de0 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74111e40 con 0x7f7a74102790 2024-09-05T07:49:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a79800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74112140 con 0x7f7a74106f10 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.028+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52160/0 (socket says 172.21.15.144:52160) 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a72a00640 1 -- 172.21.15.144:0/4272394047 learned_addr learned my addr 172.21.15.144:0/4272394047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 0x7f7a74198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a73400640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74106f10 0x7f7a7419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 -- 172.21.15.144:0/4272394047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74106f10 msgr2=0x7f7a7419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74106f10 0x7f7a7419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 -- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 msgr2=0x7f7a74198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 -- 172.21.15.144:0/4272394047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7419d3f0 con 0x7f7a74102790 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a72a00640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.029+0000 7f7a6a000640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 0x7f7a74198980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00eb00 tx=0x7f7a5c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.030+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c010430 con 0x7f7a74102790 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.030+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7419d6e0 con 0x7f7a74102790 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.030+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a5c010ab0 con 0x7f7a74102790 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.030+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c017bb0 con 0x7f7a74102790 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.030+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741a4fc0 con 0x7f7a74102790 2024-09-05T07:49:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.031+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a741021c0 con 0x7f7a74102790 2024-09-05T07:49:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.033+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7a5c010c60 con 0x7f7a74102790 2024-09-05T07:49:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.034+0000 7f7a6be00640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 0x7f7a580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.034+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f7a5c0cfb90 con 0x7f7a74102790 2024-09-05T07:49:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.034+0000 7f7a72a00640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 0x7f7a580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.035+0000 7f7a72a00640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 0x7f7a580a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7a640096c0 tx=0x7f7a640046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.037+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a5c0541b0 con 0x7f7a74102790 2024-09-05T07:49:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.250+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a7402d7c0 con 0x7f7a74102790 2024-09-05T07:49:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.368+0000 7f7a6be00640 1 -- 172.21.15.144:0/4272394047 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f7a5c09cba0 con 0x7f7a74102790 2024-09-05T07:49:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 msgr2=0x7f7a580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 0x7f7a580a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7a640096c0 tx=0x7f7a640046c0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 msgr2=0x7f7a74198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 0x7f7a74198980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00eb00 tx=0x7f7a5c00c2d0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 shutdown_connections 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7a580a2b80 0x7f7a580a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74102790 0x7f7a74198980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a74106f10 0x7f7a7419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 --2- 172.21.15.144:0/4272394047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a74101de0 0x7f7a74198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 >> 172.21.15.144:0/4272394047 conn(0x7f7a740fd8c0 msgr2=0x7f7a740febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 shutdown_connections 2024-09-05T07:49:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:29.371+0000 7f7a79800640 1 -- 172.21.15.144:0/4272394047 wait complete. 2024-09-05T07:49:29.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:29 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:active 2024-09-05T07:49:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:29 smithi144 ceph-mon[29535]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-05T07:49:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:29 smithi144 ceph-mon[29535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:29 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4272394047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:29.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:29 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:29.687 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: 2024-09-05T07:49:29.314+0000 7f079f0ce640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-05T07:49:29.687 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: 2024-09-05T07:49:29.314+0000 7f079f0ce640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-05T07:49:29.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:active 2024-09-05T07:49:29.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-mon[34710]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-05T07:49:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-mon[34710]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4272394047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:29.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:29 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:29 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] up:active 2024-09-05T07:49:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:29 smithi175 ceph-mon[34585]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-05T07:49:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:29 smithi175 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:29 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4272394047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:29.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:29 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T07:49:30.135 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-05T07:49:30.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-05T07:49:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:30.645 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:30 smithi144 ceph-mon[29535]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s wr, 13 op/s 2024-09-05T07:49:30.645 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:30 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T07:49:30.645 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:30 smithi144 ceph-mon[29535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:30 smithi154 ceph-mon[34710]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s wr, 13 op/s 2024-09-05T07:49:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:30 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T07:49:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:30 smithi154 ceph-mon[34710]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:30 smithi175 ceph-mon[34585]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s wr, 13 op/s 2024-09-05T07:49:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:30 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T07:49:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:30 smithi175 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:49:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 -- 172.21.15.144:0/2167164431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4103e30 msgr2=0x7f9df4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 --2- 172.21.15.144:0/2167164431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4103e30 0x7f9df4104210 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009900 tx=0x7f9de402a410 comp rx=0 tx=0).stop 2024-09-05T07:49:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 -- 172.21.15.144:0/2167164431 shutdown_connections 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 --2- 172.21.15.144:0/2167164431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df4108f60 0x7f9df4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 --2- 172.21.15.144:0/2167164431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df41047e0 0x7f9df4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 --2- 172.21.15.144:0/2167164431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4103e30 0x7f9df4104210 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 -- 172.21.15.144:0/2167164431 >> 172.21.15.144:0/2167164431 conn(0x7f9df40ff8d0 msgr2=0x7f9df4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 -- 172.21.15.144:0/2167164431 shutdown_connections 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.206+0000 7f9df8a00640 1 -- 172.21.15.144:0/2167164431 wait complete. 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 Processor -- start 2024-09-05T07:49:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 -- start start 2024-09-05T07:49:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 0x7f9df419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 0x7f9df419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 0x7f9df419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4113f80 con 0x7f9df4108f60 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4113e00 con 0x7f9df41047e0 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.207+0000 7f9df8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4114100 con 0x7f9df4103e30 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 0x7f9df419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 0x7f9df419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 0x7f9df419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:50918/0 (socket says 172.21.15.144:50918) 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9debe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 0x7f9df419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df2800640 1 -- 172.21.15.144:0/1340373860 learned_addr learned my addr 172.21.15.144:0/1340373860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 -- 172.21.15.144:0/1340373860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 msgr2=0x7f9df419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:31.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 0x7f9df419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 -- 172.21.15.144:0/1340373860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 msgr2=0x7f9df419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 0x7f9df419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 -- 172.21.15.144:0/1340373860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df419f430 con 0x7f9df4108f60 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9debe00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 0x7f9df419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.208+0000 7f9df3200640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 0x7f9df419ed50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009fd0 tx=0x7f9dec00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.209+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00ce20 con 0x7f9df4108f60 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.209+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec005020 con 0x7f9df4108f60 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.209+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec010720 con 0x7f9df4108f60 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.209+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df419f720 con 0x7f9df4108f60 2024-09-05T07:49:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.209+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df41a7000 con 0x7f9df4108f60 2024-09-05T07:49:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.210+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df4104210 con 0x7f9df4108f60 2024-09-05T07:49:31.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.212+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9dec005540 con 0x7f9df4108f60 2024-09-05T07:49:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.213+0000 7f9deb400640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 0x7f9dd80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.213+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f9dec0cf550 con 0x7f9df4108f60 2024-09-05T07:49:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.213+0000 7f9df2800640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 0x7f9dd80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.214+0000 7f9df2800640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 0x7f9dd80a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9de40096c0 tx=0x7f9de4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.217+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dec09c560 con 0x7f9df4108f60 2024-09-05T07:49:31.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.420+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9df4062630 con 0x7f9dd80a2c00 2024-09-05T07:49:31.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.452+0000 7f9deb400640 1 -- 172.21.15.144:0/1340373860 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9df4062630 con 0x7f9dd80a2c00 2024-09-05T07:49:31.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 msgr2=0x7f9dd80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:31.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 0x7f9dd80a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9de40096c0 tx=0x7f9de4005a20 comp rx=0 tx=0).stop 2024-09-05T07:49:31.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 msgr2=0x7f9df419ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:31.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 0x7f9df419ed50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009fd0 tx=0x7f9dec00ef10 comp rx=0 tx=0).stop 2024-09-05T07:49:31.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 shutdown_connections 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9dd80a2c00 0x7f9dd80a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9df41047e0 0x7f9df419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9df4108f60 0x7f9df419ed50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 --2- 172.21.15.144:0/1340373860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9df4103e30 0x7f9df419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 >> 172.21.15.144:0/1340373860 conn(0x7f9df40ff8d0 msgr2=0x7f9df4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 shutdown_connections 2024-09-05T07:49:31.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:31.454+0000 7f9df8a00640 1 -- 172.21.15.144:0/1340373860 wait complete. 2024-09-05T07:49:31.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:49:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:49:31.427+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:49:31.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:49:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:49:31.427+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:49:31.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:49:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:49:31.427+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:49:31.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:49:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:49:31.427+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:49:31.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:49:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:49:31.427+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:49:32.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-05T07:49:32.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:32 smithi144 ceph-mon[29535]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-05T07:49:32.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:32 smithi144 ceph-mon[29535]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:32 smithi154 ceph-mon[34710]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-05T07:49:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:32 smithi154 ceph-mon[34710]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:32.712 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:32 smithi175 ceph-mon[34585]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-05T07:49:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:32 smithi175 ceph-mon[34585]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 -- 172.21.15.144:0/1003481598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3818109140 msgr2=0x7f3818110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 --2- 172.21.15.144:0/1003481598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3818109140 0x7f3818110cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3810009ca0 tx=0x7f381002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 -- 172.21.15.144:0/1003481598 shutdown_connections 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 --2- 172.21.15.144:0/1003481598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3818109140 0x7f3818110cc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 --2- 172.21.15.144:0/1003481598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38181049c0 0x7f3818108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 --2- 172.21.15.144:0/1003481598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818104010 0x7f38181043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 -- 172.21.15.144:0/1003481598 >> 172.21.15.144:0/1003481598 conn(0x7f38180ffa50 msgr2=0x7f3818101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 -- 172.21.15.144:0/1003481598 shutdown_connections 2024-09-05T07:49:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.301+0000 7f381ea00640 1 -- 172.21.15.144:0/1003481598 wait complete. 2024-09-05T07:49:33.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 Processor -- start 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 -- start start 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 0x7f381819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 0x7f381819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818109140 0x7f381819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3818114210 con 0x7f38181049c0 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3818114090 con 0x7f3818109140 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.302+0000 7f381ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3818114390 con 0x7f3818104010 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f380fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 0x7f381819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f380fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 0x7f381819ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51836/0 (socket says 172.21.15.144:51836) 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 0x7f381819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:33.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f380fe00640 1 -- 172.21.15.144:0/1210763160 learned_addr learned my addr 172.21.15.144:0/1210763160 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f381ca00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818109140 0x7f381819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 -- 172.21.15.144:0/1210763160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818109140 msgr2=0x7f381819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818109140 0x7f381819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 -- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 msgr2=0x7f381819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 0x7f381819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 -- 172.21.15.144:0/1210763160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381819f6c0 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.303+0000 7f3817e00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 0x7f381819a710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f380800e9f0 tx=0x7f380800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.304+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380800ccc0 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.304+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3808010910 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.304+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381819f9b0 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.304+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808018960 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.304+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38181a7290 con 0x7f3818104010 2024-09-05T07:49:33.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.305+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38181043f0 con 0x7f3818104010 2024-09-05T07:49:33.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.307+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3808010ac0 con 0x7f3818104010 2024-09-05T07:49:33.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.308+0000 7f3815600640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 0x7f37fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:33.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.308+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f38080cf6a0 con 0x7f3818104010 2024-09-05T07:49:33.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.308+0000 7f380fe00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 0x7f37fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:33.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.309+0000 7f380fe00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 0x7f37fc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f381810ab10 tx=0x7f38000091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:33.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.310+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f380809c060 con 0x7f3818104010 2024-09-05T07:49:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.386+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f38080986d0 con 0x7f3818104010 2024-09-05T07:49:33.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.522+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3818062630 con 0x7f37fc0a2b80 2024-09-05T07:49:33.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.548+0000 7f3815600640 1 -- 172.21.15.144:0/1210763160 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3818062630 con 0x7f37fc0a2b80 2024-09-05T07:49:33.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 msgr2=0x7f37fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:33.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 0x7f37fc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f381810ab10 tx=0x7f38000091c0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 msgr2=0x7f381819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:33.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 0x7f381819a710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f380800e9f0 tx=0x7f380800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 shutdown_connections 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f37fc0a2b80 0x7f37fc0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3818109140 0x7f381819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38181049c0 0x7f381819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 --2- 172.21.15.144:0/1210763160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3818104010 0x7f381819a710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.550+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 >> 172.21.15.144:0/1210763160 conn(0x7f38180ffa50 msgr2=0x7f3818100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.551+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 shutdown_connections 2024-09-05T07:49:33.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:33.551+0000 7f381ea00640 1 -- 172.21.15.144:0/1210763160 wait complete. 2024-09-05T07:49:34.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-05T07:49:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:34 smithi154 ceph-mon[34710]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-05T07:49:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:34 smithi154 ceph-mon[34710]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T07:49:34.800 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:34 smithi144 ceph-mon[29535]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-05T07:49:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:34 smithi144 ceph-mon[29535]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T07:49:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:34 smithi175 ceph-mon[34585]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-05T07:49:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:34 smithi175 ceph-mon[34585]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.386+0000 7fe5db200640 1 -- 172.21.15.144:0/203281890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc1079d0 msgr2=0x7fe5dc107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.386+0000 7fe5db200640 1 --2- 172.21.15.144:0/203281890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc107db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009930 tx=0x7fe5cc02a420 comp rx=0 tx=0).stop 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 -- 172.21.15.144:0/203281890 shutdown_connections 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 --2- 172.21.15.144:0/203281890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 --2- 172.21.15.144:0/203281890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc102370 0x7fe5dc10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 --2- 172.21.15.144:0/203281890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc107db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 -- 172.21.15.144:0/203281890 >> 172.21.15.144:0/203281890 conn(0x7fe5dc0fd710 msgr2=0x7fe5dc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 -- 172.21.15.144:0/203281890 shutdown_connections 2024-09-05T07:49:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.387+0000 7fe5db200640 1 -- 172.21.15.144:0/203281890 wait complete. 2024-09-05T07:49:35.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 Processor -- start 2024-09-05T07:49:35.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 -- start start 2024-09-05T07:49:35.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 0x7fe5dc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc111e20 con 0x7fe5dc1019d0 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc111ca0 con 0x7fe5dc1079d0 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5db200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc111fa0 con 0x7fe5dc102370 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.388+0000 7fe5d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 0x7fe5dc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51854/0 (socket says 172.21.15.144:51854) 2024-09-05T07:49:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9e00640 1 -- 172.21.15.144:0/979753708 learned_addr learned my addr 172.21.15.144:0/979753708 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5da800640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 -- 172.21.15.144:0/979753708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1079d0 msgr2=0x7fe5dc19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 -- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 msgr2=0x7fe5dc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 -- 172.21.15.144:0/979753708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc19f460 con 0x7fe5dc102370 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d9400640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 0x7fe5dc19a9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e9f0 tx=0x7fe5c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800ccc0 con 0x7fe5dc102370 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8005020 con 0x7fe5dc102370 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.389+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc19f750 con 0x7fe5dc102370 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.390+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80049e0 con 0x7fe5dc102370 2024-09-05T07:49:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.390+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1a7030 con 0x7fe5dc102370 2024-09-05T07:49:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.391+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc101e30 con 0x7fe5dc102370 2024-09-05T07:49:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.392+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe5c8005560 con 0x7fe5dc102370 2024-09-05T07:49:35.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.395+0000 7fe5d2a00640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 0x7fe5c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:35.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.395+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fe5c80cf0a0 con 0x7fe5dc102370 2024-09-05T07:49:35.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.395+0000 7fe5d9e00640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 0x7fe5c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:35.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.395+0000 7fe5d9e00640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 0x7fe5c00a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0096c0 tx=0x7fe5cc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:35.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.397+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe5c80051d0 con 0x7fe5dc102370 2024-09-05T07:49:35.573 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:35 smithi144 ceph-mon[29535]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.599+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe5dc0fe390 con 0x7fe5c00a2c10 2024-09-05T07:49:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.604+0000 7fe5d2a00640 1 -- 172.21.15.144:0/979753708 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe5dc0fe390 con 0x7fe5c00a2c10 2024-09-05T07:49:35.604 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/qa/sv_0/62ebb861-9767-43dc-98fd-398342913605 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 msgr2=0x7fe5c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 0x7fe5c00a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0096c0 tx=0x7fe5cc005b50 comp rx=0 tx=0).stop 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 msgr2=0x7fe5dc19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 0x7fe5dc19a9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e9f0 tx=0x7fe5c800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 shutdown_connections 2024-09-05T07:49:35.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe5c00a2c10 0x7fe5c00a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5dc1079d0 0x7fe5dc19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5dc102370 0x7fe5dc19a9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 --2- 172.21.15.144:0/979753708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5dc1019d0 0x7fe5dc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 >> 172.21.15.144:0/979753708 conn(0x7fe5dc0fd710 msgr2=0x7fe5dc0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 shutdown_connections 2024-09-05T07:49:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:35.606+0000 7fe5db200640 1 -- 172.21.15.144:0/979753708 wait complete. 2024-09-05T07:49:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:35 smithi154 ceph-mon[34710]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:35.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:35 smithi175 ceph-mon[34585]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:36.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-05T07:49:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:36 smithi154 ceph-mon[34710]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:36 smithi144 ceph-mon[29535]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:36.835 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:36 smithi175 ceph-mon[34585]: pgmap v298: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:37.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 -- 172.21.15.144:0/1616857680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4108f60 msgr2=0x7fc1e4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 --2- 172.21.15.144:0/1616857680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4108f60 0x7fc1e4110ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009ca0 tx=0x7fc1dc02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 -- 172.21.15.144:0/1616857680 shutdown_connections 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 --2- 172.21.15.144:0/1616857680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 0x7fc1e4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 --2- 172.21.15.144:0/1616857680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4108f60 0x7fc1e4110ae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 --2- 172.21.15.144:0/1616857680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4103e30 0x7fc1e4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 -- 172.21.15.144:0/1616857680 >> 172.21.15.144:0/1616857680 conn(0x7fc1e40ff910 msgr2=0x7fc1e4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 -- 172.21.15.144:0/1616857680 shutdown_connections 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.414+0000 7fc1e9000640 1 -- 172.21.15.144:0/1616857680 wait complete. 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.415+0000 7fc1e9000640 1 Processor -- start 2024-09-05T07:49:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.415+0000 7fc1e9000640 1 -- start start 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.415+0000 7fc1e9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e9000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 0x7fc1e419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4108f60 0x7fc1e419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e9000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4114010 con 0x7fc1e4103e30 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e9000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4113e90 con 0x7fc1e41047e0 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4114190 con 0x7fc1e4108f60 2024-09-05T07:49:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51862/0 (socket says 172.21.15.144:51862) 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 -- 172.21.15.144:0/2041562629 learned_addr learned my addr 172.21.15.144:0/2041562629 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3e00640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4108f60 0x7fc1e419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e2a00640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 0x7fc1e419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 -- 172.21.15.144:0/2041562629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4108f60 msgr2=0x7fc1e419eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4108f60 0x7fc1e419eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 -- 172.21.15.144:0/2041562629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 msgr2=0x7fc1e419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 0x7fc1e419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.416+0000 7fc1e3400640 1 -- 172.21.15.144:0/2041562629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e419f380 con 0x7fc1e4103e30 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1e3400640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400ea60 tx=0x7fc1d400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400cde0 con 0x7fc1e4103e30 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d40035f0 con 0x7fc1e4103e30 2024-09-05T07:49:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e419f670 con 0x7fc1e4103e30 2024-09-05T07:49:37.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4010670 con 0x7fc1e4103e30 2024-09-05T07:49:37.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.417+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41a6f50 con 0x7fc1e4103e30 2024-09-05T07:49:37.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.418+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4105310 con 0x7fc1e4103e30 2024-09-05T07:49:37.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.420+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc1d40037a0 con 0x7fc1e4103e30 2024-09-05T07:49:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.421+0000 7fc1dbe00640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 0x7fc1c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.421+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fc1d40cf3a0 con 0x7fc1e4103e30 2024-09-05T07:49:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.421+0000 7fc1e2a00640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 0x7fc1c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.422+0000 7fc1e2a00640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 0x7fc1c80a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1e410a930 tx=0x7fc1d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.425+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1d409c250 con 0x7fc1e4103e30 2024-09-05T07:49:37.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:37 smithi144 ceph-mon[29535]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:37.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.624+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc1e4062630 con 0x7fc1c80a2c10 2024-09-05T07:49:37.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.650+0000 7fc1dbe00640 1 -- 172.21.15.144:0/2041562629 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc1e4062630 con 0x7fc1c80a2c10 2024-09-05T07:49:37.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.652+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 msgr2=0x7fc1c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.652+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 0x7fc1c80a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1e410a930 tx=0x7fc1d0005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.652+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 msgr2=0x7fc1e419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.652+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400ea60 tx=0x7fc1d400ef20 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 shutdown_connections 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc1c80a2c10 0x7fc1c80a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e41047e0 0x7fc1e419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1e4108f60 0x7fc1e419eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 --2- 172.21.15.144:0/2041562629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e4103e30 0x7fc1e419a3d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 >> 172.21.15.144:0/2041562629 conn(0x7fc1e40ff910 msgr2=0x7fc1e4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 shutdown_connections 2024-09-05T07:49:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:37.653+0000 7fc1e9000640 1 -- 172.21.15.144:0/2041562629 wait complete. 2024-09-05T07:49:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:37 smithi154 ceph-mon[34710]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:37.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:37 smithi175 ceph-mon[34585]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:38.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-05T07:49:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:38 smithi154 ceph-mon[34710]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:38.771 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:38 smithi144 ceph-mon[29535]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:38 smithi175 ceph-mon[34585]: pgmap v299: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-05T07:49:39.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 -- 172.21.15.144:0/2356309037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1079c0 msgr2=0x7f137c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:39.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 --2- 172.21.15.144:0/2356309037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1079c0 0x7f137c107da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f136c009930 tx=0x7f136c02a420 comp rx=0 tx=0).stop 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 -- 172.21.15.144:0/2356309037 shutdown_connections 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 --2- 172.21.15.144:0/2356309037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c102360 0x7f137c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 --2- 172.21.15.144:0/2356309037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c1019c0 0x7f137c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 --2- 172.21.15.144:0/2356309037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1079c0 0x7f137c107da0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 -- 172.21.15.144:0/2356309037 >> 172.21.15.144:0/2356309037 conn(0x7f137c0fd6e0 msgr2=0x7f137c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 -- 172.21.15.144:0/2356309037 shutdown_connections 2024-09-05T07:49:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.322+0000 7f1380a00640 1 -- 172.21.15.144:0/2356309037 wait complete. 2024-09-05T07:49:39.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.323+0000 7f1380a00640 1 Processor -- start 2024-09-05T07:49:39.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 -- start start 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 0x7f137c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c1079c0 0x7f137c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f137c111e10 con 0x7f137c1019c0 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f137c111c90 con 0x7f137c1079c0 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1380a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f137c111f90 con 0x7f137c102360 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f137b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f137b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51886/0 (socket says 172.21.15.144:51886) 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f137b400640 1 -- 172.21.15.144:0/1727041171 learned_addr learned my addr 172.21.15.144:0/1727041171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f1373e00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 0x7f137c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.324+0000 7f137be00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c1079c0 0x7f137c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 -- 172.21.15.144:0/1727041171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 msgr2=0x7f137c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 0x7f137c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 -- 172.21.15.144:0/1727041171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c1079c0 msgr2=0x7f137c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c1079c0 0x7f137c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 -- 172.21.15.144:0/1727041171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c19f480 con 0x7f137c1019c0 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f1373e00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 0x7f137c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:39.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f137b400640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f136c02a940 tx=0x7f136c003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c03f070 con 0x7f137c1019c0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f136c031c90 con 0x7f137c1019c0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c19f710 con 0x7f137c1019c0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.325+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c035030 con 0x7f137c1019c0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.326+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c1a7050 con 0x7f137c1019c0 2024-09-05T07:49:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.327+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c101e20 con 0x7f137c1019c0 2024-09-05T07:49:39.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.328+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f136c042070 con 0x7f137c1019c0 2024-09-05T07:49:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.329+0000 7f1378c00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 0x7f13600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.330+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f136c0ef700 con 0x7f137c1019c0 2024-09-05T07:49:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.330+0000 7f1373e00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 0x7f13600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:39.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.330+0000 7f1373e00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 0x7f13600a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f137c10dfd0 tx=0x7f1364005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.334+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f136c0bbf60 con 0x7f137c1019c0 2024-09-05T07:49:39.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.536+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f137c0fec50 con 0x7f13600a2c90 2024-09-05T07:49:39.536 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:39 smithi144 ceph-mon[29535]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:39.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.540+0000 7f1378c00640 1 -- 172.21.15.144:0/1727041171 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f137c0fec50 con 0x7f13600a2c90 2024-09-05T07:49:39.541 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/qa/sv_1/e2396d72-2b7f-4b5e-8ff9-57cbc3a420d2 2024-09-05T07:49:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 msgr2=0x7f13600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 0x7f13600a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f137c10dfd0 tx=0x7f1364005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 msgr2=0x7f137c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f136c02a940 tx=0x7f136c003b20 comp rx=0 tx=0).stop 2024-09-05T07:49:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 shutdown_connections 2024-09-05T07:49:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13600a2c90 0x7f13600a5150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f137c1079c0 0x7f137c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f137c102360 0x7f137c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 --2- 172.21.15.144:0/1727041171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f137c1019c0 0x7f137c19a4d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 >> 172.21.15.144:0/1727041171 conn(0x7f137c0fd6e0 msgr2=0x7f137c10d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 shutdown_connections 2024-09-05T07:49:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:39.543+0000 7f1380a00640 1 -- 172.21.15.144:0/1727041171 wait complete. 2024-09-05T07:49:39.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:39 smithi154 ceph-mon[34710]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:39.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:39 smithi175 ceph-mon[34585]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:40.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:49:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:40 smithi154 ceph-mon[34710]: pgmap v300: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 22 op/s 2024-09-05T07:49:40.768 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:40.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:40 smithi144 ceph-mon[29535]: pgmap v300: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 22 op/s 2024-09-05T07:49:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:40 smithi175 ceph-mon[34585]: pgmap v300: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 22 op/s 2024-09-05T07:49:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 -- 172.21.15.144:0/4249868909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26401049a0 msgr2=0x7f26401089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 --2- 172.21.15.144:0/4249868909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26401049a0 0x7f26401089f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f262c009900 tx=0x7f262c02a410 comp rx=0 tx=0).stop 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 -- 172.21.15.144:0/4249868909 shutdown_connections 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 --2- 172.21.15.144:0/4249868909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 0x7f2640110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 --2- 172.21.15.144:0/4249868909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26401049a0 0x7f26401089f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 --2- 172.21.15.144:0/4249868909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2640103ff0 0x7f26401043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 -- 172.21.15.144:0/4249868909 >> 172.21.15.144:0/4249868909 conn(0x7f26400ffa90 msgr2=0x7f2640101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 -- 172.21.15.144:0/4249868909 shutdown_connections 2024-09-05T07:49:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.367+0000 7f2646800640 1 -- 172.21.15.144:0/4249868909 wait complete. 2024-09-05T07:49:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 Processor -- start 2024-09-05T07:49:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 -- start start 2024-09-05T07:49:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26401049a0 0x7f264019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 0x7f264019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2640114170 con 0x7f2640103ff0 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2640113ff0 con 0x7f2640109120 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f2646800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26401142f0 con 0x7f26401049a0 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f263f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f263f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51906/0 (socket says 172.21.15.144:51906) 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f263f400640 1 -- 172.21.15.144:0/2061457189 learned_addr learned my addr 172.21.15.144:0/2061457189 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.369+0000 7f263ea00640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26401049a0 0x7f264019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263fe00640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 0x7f264019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 -- 172.21.15.144:0/2061457189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26401049a0 msgr2=0x7f264019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26401049a0 0x7f264019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 -- 172.21.15.144:0/2061457189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 msgr2=0x7f264019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 0x7f264019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 -- 172.21.15.144:0/2061457189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264019f600 con 0x7f2640103ff0 2024-09-05T07:49:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f263f400640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f263000e9f0 tx=0x7f263000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263000cd80 con 0x7f2640103ff0 2024-09-05T07:49:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264019f8f0 con 0x7f2640103ff0 2024-09-05T07:49:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.370+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2630010910 con 0x7f2640103ff0 2024-09-05T07:49:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.371+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26300188f0 con 0x7f2640103ff0 2024-09-05T07:49:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.371+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a71d0 con 0x7f2640103ff0 2024-09-05T07:49:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.372+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26401043d0 con 0x7f2640103ff0 2024-09-05T07:49:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.373+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2630010ac0 con 0x7f2640103ff0 2024-09-05T07:49:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.375+0000 7f2637e00640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 0x7f26240a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.375+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f26300cf460 con 0x7f2640103ff0 2024-09-05T07:49:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.375+0000 7f263ea00640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 0x7f26240a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.376+0000 7f263ea00640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 0x7f26240a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f262c000c00 tx=0x7f262c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:41.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.378+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f263009bcc0 con 0x7f2640103ff0 2024-09-05T07:49:41.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:41 smithi144 ceph-mon[29535]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:41.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.595+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f264010c390 con 0x7f2640103ff0 2024-09-05T07:49:41.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.596+0000 7f2637e00640 1 -- 172.21.15.144:0/2061457189 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7f263009ffc0 con 0x7f2640103ff0 2024-09-05T07:49:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:41.596 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:49:41.597 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:49:41.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 msgr2=0x7f26240a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 0x7f26240a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f262c000c00 tx=0x7f262c005b50 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 msgr2=0x7f264019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f263000e9f0 tx=0x7f263000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 shutdown_connections 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26240a2c90 0x7f26240a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2640109120 0x7f264019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26401049a0 0x7f264019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 --2- 172.21.15.144:0/2061457189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2640103ff0 0x7f264019a650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 >> 172.21.15.144:0/2061457189 conn(0x7f26400ffa90 msgr2=0x7f2640100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 shutdown_connections 2024-09-05T07:49:41.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:41.599+0000 7f2646800640 1 -- 172.21.15.144:0/2061457189 wait complete. 2024-09-05T07:49:41.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:41 smithi154 ceph-mon[34710]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:41.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:41 smithi175 ceph-mon[34585]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:49:42.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:49:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:42 smithi154 ceph-mon[34710]: pgmap v301: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-05T07:49:42.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:42 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2061457189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:42.796 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:42.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:42 smithi144 ceph-mon[29535]: pgmap v301: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-05T07:49:42.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:42 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2061457189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:42 smithi175 ceph-mon[34585]: pgmap v301: 97 pgs: 97 active+clean; 606 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-05T07:49:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:42 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2061457189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:49:43.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 -- 172.21.15.144:0/1440028486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0106f10 msgr2=0x7f57f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:43.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 --2- 172.21.15.144:0/1440028486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0106f10 0x7f57f010ea90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ca0 tx=0x7f57e802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 -- 172.21.15.144:0/1440028486 shutdown_connections 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 --2- 172.21.15.144:0/1440028486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0106f10 0x7f57f010ea90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 --2- 172.21.15.144:0/1440028486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0102790 0x7f57f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 --2- 172.21.15.144:0/1440028486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 -- 172.21.15.144:0/1440028486 >> 172.21.15.144:0/1440028486 conn(0x7f57f00fd8c0 msgr2=0x7f57f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 -- 172.21.15.144:0/1440028486 shutdown_connections 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.357+0000 7f57f8000640 1 -- 172.21.15.144:0/1440028486 wait complete. 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.358+0000 7f57f8000640 1 Processor -- start 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.358+0000 7f57f8000640 1 -- start start 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0102790 0x7f57f019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0106f10 0x7f57f019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111fc0 con 0x7f57f0106f10 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111e40 con 0x7f57f0101de0 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f8000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0112140 con 0x7f57f0102790 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0106f10 0x7f57f019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:44414/0 (socket says 172.21.15.144:44414) 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 -- 172.21.15.144:0/3388734949 learned_addr learned my addr 172.21.15.144:0/3388734949 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f4c00640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0102790 0x7f57f019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 -- 172.21.15.144:0/3388734949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0102790 msgr2=0x7f57f019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0102790 0x7f57f019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 -- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0106f10 msgr2=0x7f57f019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0106f10 0x7f57f019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.359+0000 7f57f5600640 1 -- 172.21.15.144:0/3388734949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019f610 con 0x7f57f0101de0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57f5600640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9f0 tx=0x7f57e400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e400cd80 con 0x7f57f0101de0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e4005500 con 0x7f57f0101de0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f019f900 con 0x7f57f0101de0 2024-09-05T07:49:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4010690 con 0x7f57f0101de0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.360+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a71e0 con 0x7f57f0101de0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.361+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f01021c0 con 0x7f57f0101de0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.363+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f57e40046c0 con 0x7f57f0101de0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.364+0000 7f57ee000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 0x7f57d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.365+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f57e40cf4e0 con 0x7f57f0101de0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.365+0000 7f57f4c00640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 0x7f57d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.365+0000 7f57f4c00640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 0x7f57d80a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0095f0 tx=0x7f57dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.367+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57e409c390 con 0x7f57f0101de0 2024-09-05T07:49:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.544+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57f019b9c0 con 0x7f57f0101de0 2024-09-05T07:49:43.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.546+0000 7f57ee000640 1 -- 172.21.15.144:0/3388734949 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22370 (secure 0 0 0) 0x7f57e409bc90 con 0x7f57f0101de0 2024-09-05T07:49:43.547 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:43.547 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:49:15.848324+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 msgr2=0x7f57d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 0x7f57d80a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0095f0 tx=0x7f57dc005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 msgr2=0x7f57f019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9f0 tx=0x7f57e400edf0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 shutdown_connections 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f57d80a2c10 0x7f57d80a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f0106f10 0x7f57f019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0102790 0x7f57f019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 --2- 172.21.15.144:0/3388734949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0101de0 0x7f57f019a660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 >> 172.21.15.144:0/3388734949 conn(0x7f57f00fd8c0 msgr2=0x7f57f00fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 shutdown_connections 2024-09-05T07:49:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:43.549+0000 7f57f8000640 1 -- 172.21.15.144:0/3388734949 wait complete. 2024-09-05T07:49:44.369 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T07:49:44.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T07:49:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:44 smithi154 ceph-mon[34710]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-05T07:49:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:44 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3388734949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:44.738 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:44.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:44 smithi144 ceph-mon[29535]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-05T07:49:44.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:44 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3388734949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:44 smithi175 ceph-mon[34585]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-05T07:49:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:44 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3388734949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:45.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 -- 172.21.15.144:0/3288886284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b81047e0 msgr2=0x7f09b8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 --2- 172.21.15.144:0/3288886284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b81047e0 0x7f09b8108830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009900 tx=0x7f09a002a410 comp rx=0 tx=0).stop 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 -- 172.21.15.144:0/3288886284 shutdown_connections 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 --2- 172.21.15.144:0/3288886284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b8108f60 0x7f09b8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 --2- 172.21.15.144:0/3288886284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b81047e0 0x7f09b8108830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 --2- 172.21.15.144:0/3288886284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8103e30 0x7f09b8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 -- 172.21.15.144:0/3288886284 >> 172.21.15.144:0/3288886284 conn(0x7f09b80ff910 msgr2=0x7f09b8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 -- 172.21.15.144:0/3288886284 shutdown_connections 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.283+0000 7f09b7e00640 1 -- 172.21.15.144:0/3288886284 wait complete. 2024-09-05T07:49:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 Processor -- start 2024-09-05T07:49:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 -- start start 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b81047e0 0x7f09b819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8108f60 0x7f09b819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8114010 con 0x7f09b8103e30 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8113e90 con 0x7f09b8108f60 2024-09-05T07:49:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.284+0000 7f09b7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8114190 con 0x7f09b81047e0 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57580/0 (socket says 172.21.15.144:57580) 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 -- 172.21.15.144:0/2137623053 learned_addr learned my addr 172.21.15.144:0/2137623053 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b7400640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8108f60 0x7f09b819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09afe00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b81047e0 0x7f09b819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 -- 172.21.15.144:0/2137623053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b81047e0 msgr2=0x7f09b819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b81047e0 0x7f09b819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 -- 172.21.15.144:0/2137623053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8108f60 msgr2=0x7f09b819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8108f60 0x7f09b819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 -- 172.21.15.144:0/2137623053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b819f420 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.285+0000 7f09b6a00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e9f0 tx=0x7f09a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.286+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a800cd80 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.286+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09a8010910 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.286+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b819f710 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.286+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8018990 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.286+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b81a6ff0 con 0x7f09b8103e30 2024-09-05T07:49:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.287+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b8105310 con 0x7f09b8103e30 2024-09-05T07:49:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.289+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f09a8010ac0 con 0x7f09b8103e30 2024-09-05T07:49:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.290+0000 7f09af400640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 0x7f099c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.290+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f09a80cf800 con 0x7f09b8103e30 2024-09-05T07:49:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.290+0000 7f09afe00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 0x7f099c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.291+0000 7f09afe00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 0x7f099c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.293+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09a809c060 con 0x7f09b8103e30 2024-09-05T07:49:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.468+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09b8062630 con 0x7f099c0a2c10 2024-09-05T07:49:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.476+0000 7f09af400640 1 -- 172.21.15.144:0/2137623053 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258912 (secure 0 0 0) 0x7f09b8062630 con 0x7f099c0a2c10 2024-09-05T07:49:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:45.481 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-05T07:49:45.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 msgr2=0x7f099c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:45.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 0x7f099c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a0005b50 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 msgr2=0x7f09b819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e9f0 tx=0x7f09a800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 shutdown_connections 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f099c0a2c10 0x7f099c0a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.480+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b8108f60 0x7f09b819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.481+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b81047e0 0x7f09b819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.481+0000 7f09b7e00640 1 --2- 172.21.15.144:0/2137623053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09b8103e30 0x7f09b819a470 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.481+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 >> 172.21.15.144:0/2137623053 conn(0x7f09b80ff910 msgr2=0x7f09b8100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.481+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 shutdown_connections 2024-09-05T07:49:45.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:45.481+0000 7f09b7e00640 1 -- 172.21.15.144:0/2137623053 wait complete. 2024-09-05T07:49:46.343 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-05T07:49:45.247720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":310,"num_read_kb":261,"num_write":415,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368724,"kb_used_data":11156,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573100,"statfs":{"total":1151940427776,"available":1151562854400,"internally_reserved":0,"allocated":11423744,"data_stored":7095926,"data_compressed":107619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39608,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":104,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964456+0000","last_change":"2024-09-05T07:49:14.951174+0000","last_active":"2024-09-05T07:49:15.964456+0000","last_peered":"2024-09-05T07:49:15.964456+0000","last_clean":"2024-09-05T07:49:15.964456+0000","last_became_active":"2024-09-05T07:49:14.950781+0000","last_became_peered":"2024-09-05T07:49:14.950781+0000","last_unstale":"2024-09-05T07:49:15.964456+0000","last_undegraded":"2024-09-05T07:49:15.964456+0000","last_fullsized":"2024-09-05T07:49:15.964456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:15.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964078+0000","last_change":"2024-09-05T07:49:14.948936+0000","last_active":"2024-09-05T07:49:15.964078+0000","last_peered":"2024-09-05T07:49:15.964078+0000","last_clean":"2024-09-05T07:49:15.964078+0000","last_became_active":"2024-09-05T07:49:14.948531+0000","last_became_peered":"2024-09-05T07:49:14.948531+0000","last_unstale":"2024-09-05T07:49:15.964078+0000","last_undegraded":"2024-09-05T07:49:15.964078+0000","last_fullsized":"2024-09-05T07:49:15.964078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:42:22.735935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963916+0000","last_change":"2024-09-05T07:49:14.948848+0000","last_active":"2024-09-05T07:49:15.963916+0000","last_peered":"2024-09-05T07:49:15.963916+0000","last_clean":"2024-09-05T07:49:15.963916+0000","last_became_active":"2024-09-05T07:49:14.948581+0000","last_became_peered":"2024-09-05T07:49:14.948581+0000","last_unstale":"2024-09-05T07:49:15.963916+0000","last_undegraded":"2024-09-05T07:49:15.963916+0000","last_fullsized":"2024-09-05T07:49:15.963916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:53:22.517299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960424+0000","last_change":"2024-09-05T07:49:14.950833+0000","last_active":"2024-09-05T07:49:15.960424+0000","last_peered":"2024-09-05T07:49:15.960424+0000","last_clean":"2024-09-05T07:49:15.960424+0000","last_became_active":"2024-09-05T07:49:14.949905+0000","last_became_peered":"2024-09-05T07:49:14.949905+0000","last_unstale":"2024-09-05T07:49:15.960424+0000","last_undegraded":"2024-09-05T07:49:15.960424+0000","last_fullsized":"2024-09-05T07:49:15.960424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:29:37.999531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959721+0000","last_change":"2024-09-05T07:49:14.957903+0000","last_active":"2024-09-05T07:49:15.959721+0000","last_peered":"2024-09-05T07:49:15.959721+0000","last_clean":"2024-09-05T07:49:15.959721+0000","last_became_active":"2024-09-05T07:49:14.957559+0000","last_became_peered":"2024-09-05T07:49:14.957559+0000","last_unstale":"2024-09-05T07:49:15.959721+0000","last_undegraded":"2024-09-05T07:49:15.959721+0000","last_fullsized":"2024-09-05T07:49:15.959721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:50.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.958914+0000","last_change":"2024-09-05T07:49:14.951216+0000","last_active":"2024-09-05T07:49:15.958914+0000","last_peered":"2024-09-05T07:49:15.958914+0000","last_clean":"2024-09-05T07:49:15.958914+0000","last_became_active":"2024-09-05T07:49:14.950518+0000","last_became_peered":"2024-09-05T07:49:14.950518+0000","last_unstale":"2024-09-05T07:49:15.958914+0000","last_undegraded":"2024-09-05T07:49:15.958914+0000","last_fullsized":"2024-09-05T07:49:15.958914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:05.373083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947321+0000","last_change":"2024-09-05T07:49:14.952832+0000","last_active":"2024-09-05T07:49:15.947321+0000","last_peered":"2024-09-05T07:49:15.947321+0000","last_clean":"2024-09-05T07:49:15.947321+0000","last_became_active":"2024-09-05T07:49:14.952470+0000","last_became_peered":"2024-09-05T07:49:14.952470+0000","last_unstale":"2024-09-05T07:49:15.947321+0000","last_undegraded":"2024-09-05T07:49:15.947321+0000","last_fullsized":"2024-09-05T07:49:15.947321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:01.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959495+0000","last_change":"2024-09-05T07:49:14.958144+0000","last_active":"2024-09-05T07:49:15.959495+0000","last_peered":"2024-09-05T07:49:15.959495+0000","last_clean":"2024-09-05T07:49:15.959495+0000","last_became_active":"2024-09-05T07:49:14.957851+0000","last_became_peered":"2024-09-05T07:49:14.957851+0000","last_unstale":"2024-09-05T07:49:15.959495+0000","last_undegraded":"2024-09-05T07:49:15.959495+0000","last_fullsized":"2024-09-05T07:49:15.959495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:49:37.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947984+0000","last_change":"2024-09-05T07:49:14.954599+0000","last_active":"2024-09-05T07:49:15.947984+0000","last_peered":"2024-09-05T07:49:15.947984+0000","last_clean":"2024-09-05T07:49:15.947984+0000","last_became_active":"2024-09-05T07:49:14.954241+0000","last_became_peered":"2024-09-05T07:49:14.954241+0000","last_unstale":"2024-09-05T07:49:15.947984+0000","last_undegraded":"2024-09-05T07:49:15.947984+0000","last_fullsized":"2024-09-05T07:49:15.947984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.657195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959596+0000","last_change":"2024-09-05T07:49:14.948803+0000","last_active":"2024-09-05T07:49:15.959596+0000","last_peered":"2024-09-05T07:49:15.959596+0000","last_clean":"2024-09-05T07:49:15.959596+0000","last_became_active":"2024-09-05T07:49:14.948388+0000","last_became_peered":"2024-09-05T07:49:14.948388+0000","last_unstale":"2024-09-05T07:49:15.959596+0000","last_undegraded":"2024-09-05T07:49:15.959596+0000","last_fullsized":"2024-09-05T07:49:15.959596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.867734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947166+0000","last_change":"2024-09-05T07:49:14.955055+0000","last_active":"2024-09-05T07:49:15.947166+0000","last_peered":"2024-09-05T07:49:15.947166+0000","last_clean":"2024-09-05T07:49:15.947166+0000","last_became_active":"2024-09-05T07:49:14.954758+0000","last_became_peered":"2024-09-05T07:49:14.954758+0000","last_unstale":"2024-09-05T07:49:15.947166+0000","last_undegraded":"2024-09-05T07:49:15.947166+0000","last_fullsized":"2024-09-05T07:49:15.947166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:52.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960604+0000","last_change":"2024-09-05T07:49:14.947590+0000","last_active":"2024-09-05T07:49:15.960604+0000","last_peered":"2024-09-05T07:49:15.960604+0000","last_clean":"2024-09-05T07:49:15.960604+0000","last_became_active":"2024-09-05T07:49:14.947097+0000","last_became_peered":"2024-09-05T07:49:14.947097+0000","last_unstale":"2024-09-05T07:49:15.960604+0000","last_undegraded":"2024-09-05T07:49:15.960604+0000","last_fullsized":"2024-09-05T07:49:15.960604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:01.318442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.961184+0000","last_change":"2024-09-05T07:49:14.947195+0000","last_active":"2024-09-05T07:49:15.961184+0000","last_peered":"2024-09-05T07:49:15.961184+0000","last_clean":"2024-09-05T07:49:15.961184+0000","last_became_active":"2024-09-05T07:49:14.946874+0000","last_became_peered":"2024-09-05T07:49:14.946874+0000","last_unstale":"2024-09-05T07:49:15.961184+0000","last_undegraded":"2024-09-05T07:49:15.961184+0000","last_fullsized":"2024-09-05T07:49:15.961184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:08.582375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963657+0000","last_change":"2024-09-05T07:49:14.948203+0000","last_active":"2024-09-05T07:49:15.963657+0000","last_peered":"2024-09-05T07:49:15.963657+0000","last_clean":"2024-09-05T07:49:15.963657+0000","last_became_active":"2024-09-05T07:49:14.947748+0000","last_became_peered":"2024-09-05T07:49:14.947748+0000","last_unstale":"2024-09-05T07:49:15.963657+0000","last_undegraded":"2024-09-05T07:49:15.963657+0000","last_fullsized":"2024-09-05T07:49:15.963657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963556+0000","last_change":"2024-09-05T07:49:14.954176+0000","last_active":"2024-09-05T07:49:15.963556+0000","last_peered":"2024-09-05T07:49:15.963556+0000","last_clean":"2024-09-05T07:49:15.963556+0000","last_became_active":"2024-09-05T07:49:14.952078+0000","last_became_peered":"2024-09-05T07:49:14.952078+0000","last_unstale":"2024-09-05T07:49:15.963556+0000","last_undegraded":"2024-09-05T07:49:15.963556+0000","last_fullsized":"2024-09-05T07:49:15.963556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:38:10.311444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946774+0000","last_change":"2024-09-05T07:49:14.958096+0000","last_active":"2024-09-05T07:49:15.946774+0000","last_peered":"2024-09-05T07:49:15.946774+0000","last_clean":"2024-09-05T07:49:15.946774+0000","last_became_active":"2024-09-05T07:49:14.957219+0000","last_became_peered":"2024-09-05T07:49:14.957219+0000","last_unstale":"2024-09-05T07:49:15.946774+0000","last_undegraded":"2024-09-05T07:49:15.946774+0000","last_fullsized":"2024-09-05T07:49:15.946774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:20.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964493+0000","last_change":"2024-09-05T07:49:14.950844+0000","last_active":"2024-09-05T07:49:15.964493+0000","last_peered":"2024-09-05T07:49:15.964493+0000","last_clean":"2024-09-05T07:49:15.964493+0000","last_became_active":"2024-09-05T07:49:14.950423+0000","last_became_peered":"2024-09-05T07:49:14.950423+0000","last_unstale":"2024-09-05T07:49:15.964493+0000","last_undegraded":"2024-09-05T07:49:15.964493+0000","last_fullsized":"2024-09-05T07:49:15.964493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:53.633531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947086+0000","last_change":"2024-09-05T07:49:14.951525+0000","last_active":"2024-09-05T07:49:15.947086+0000","last_peered":"2024-09-05T07:49:15.947086+0000","last_clean":"2024-09-05T07:49:15.947086+0000","last_became_active":"2024-09-05T07:49:14.951007+0000","last_became_peered":"2024-09-05T07:49:14.951007+0000","last_unstale":"2024-09-05T07:49:15.947086+0000","last_undegraded":"2024-09-05T07:49:15.947086+0000","last_fullsized":"2024-09-05T07:49:15.947086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:18:17.895969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947606+0000","last_change":"2024-09-05T07:49:14.968131+0000","last_active":"2024-09-05T07:49:15.947606+0000","last_peered":"2024-09-05T07:49:15.947606+0000","last_clean":"2024-09-05T07:49:15.947606+0000","last_became_active":"2024-09-05T07:49:14.967843+0000","last_became_peered":"2024-09-05T07:49:14.967843+0000","last_unstale":"2024-09-05T07:49:15.947606+0000","last_undegraded":"2024-09-05T07:49:15.947606+0000","last_fullsized":"2024-09-05T07:49:15.947606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:10.271731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963754+0000","last_change":"2024-09-05T07:49:14.944475+0000","last_active":"2024-09-05T07:49:15.963754+0000","last_peered":"2024-09-05T07:49:15.963754+0000","last_clean":"2024-09-05T07:49:15.963754+0000","last_became_active":"2024-09-05T07:49:14.944114+0000","last_became_peered":"2024-09-05T07:49:14.944114+0000","last_unstale":"2024-09-05T07:49:15.963754+0000","last_undegraded":"2024-09-05T07:49:15.963754+0000","last_fullsized":"2024-09-05T07:49:15.963754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:51.097613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.962619+0000","last_change":"2024-09-05T07:49:14.955374+0000","last_active":"2024-09-05T07:49:15.962619+0000","last_peered":"2024-09-05T07:49:15.962619+0000","last_clean":"2024-09-05T07:49:15.962619+0000","last_became_active":"2024-09-05T07:49:14.955076+0000","last_became_peered":"2024-09-05T07:49:14.955076+0000","last_unstale":"2024-09-05T07:49:15.962619+0000","last_undegraded":"2024-09-05T07:49:15.962619+0000","last_fullsized":"2024-09-05T07:49:15.962619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:48.784069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947611+0000","last_change":"2024-09-05T07:49:14.957865+0000","last_active":"2024-09-05T07:49:15.947611+0000","last_peered":"2024-09-05T07:49:15.947611+0000","last_clean":"2024-09-05T07:49:15.947611+0000","last_became_active":"2024-09-05T07:49:14.957485+0000","last_became_peered":"2024-09-05T07:49:14.957485+0000","last_unstale":"2024-09-05T07:49:15.947611+0000","last_undegraded":"2024-09-05T07:49:15.947611+0000","last_fullsized":"2024-09-05T07:49:15.947611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:18.126600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959829+0000","last_change":"2024-09-05T07:49:14.957899+0000","last_active":"2024-09-05T07:49:15.959829+0000","last_peered":"2024-09-05T07:49:15.959829+0000","last_clean":"2024-09-05T07:49:15.959829+0000","last_became_active":"2024-09-05T07:49:14.957564+0000","last_became_peered":"2024-09-05T07:49:14.957564+0000","last_unstale":"2024-09-05T07:49:15.959829+0000","last_undegraded":"2024-09-05T07:49:15.959829+0000","last_fullsized":"2024-09-05T07:49:15.959829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:31.162232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959116+0000","last_change":"2024-09-05T07:49:14.958238+0000","last_active":"2024-09-05T07:49:15.959116+0000","last_peered":"2024-09-05T07:49:15.959116+0000","last_clean":"2024-09-05T07:49:15.959116+0000","last_became_active":"2024-09-05T07:49:14.957883+0000","last_became_peered":"2024-09-05T07:49:14.957883+0000","last_unstale":"2024-09-05T07:49:15.959116+0000","last_undegraded":"2024-09-05T07:49:15.959116+0000","last_fullsized":"2024-09-05T07:49:15.959116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:31:42.388350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960461+0000","last_change":"2024-09-05T07:49:14.965003+0000","last_active":"2024-09-05T07:49:15.960461+0000","last_peered":"2024-09-05T07:49:15.960461+0000","last_clean":"2024-09-05T07:49:15.960461+0000","last_became_active":"2024-09-05T07:49:14.964709+0000","last_became_peered":"2024-09-05T07:49:14.964709+0000","last_unstale":"2024-09-05T07:49:15.960461+0000","last_undegraded":"2024-09-05T07:49:15.960461+0000","last_fullsized":"2024-09-05T07:49:15.960461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:06.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947651+0000","last_change":"2024-09-05T07:49:14.946355+0000","last_active":"2024-09-05T07:49:15.947651+0000","last_peered":"2024-09-05T07:49:15.947651+0000","last_clean":"2024-09-05T07:49:15.947651+0000","last_became_active":"2024-09-05T07:49:14.946060+0000","last_became_peered":"2024-09-05T07:49:14.946060+0000","last_unstale":"2024-09-05T07:49:15.947651+0000","last_undegraded":"2024-09-05T07:49:15.947651+0000","last_fullsized":"2024-09-05T07:49:15.947651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:31.578598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964174+0000","last_change":"2024-09-05T07:49:14.947815+0000","last_active":"2024-09-05T07:49:15.964174+0000","last_peered":"2024-09-05T07:49:15.964174+0000","last_clean":"2024-09-05T07:49:15.964174+0000","last_became_active":"2024-09-05T07:49:14.947470+0000","last_became_peered":"2024-09-05T07:49:14.947470+0000","last_unstale":"2024-09-05T07:49:15.964174+0000","last_undegraded":"2024-09-05T07:49:15.964174+0000","last_fullsized":"2024-09-05T07:49:15.964174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:31.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960814+0000","last_change":"2024-09-05T07:49:14.951838+0000","last_active":"2024-09-05T07:49:15.960814+0000","last_peered":"2024-09-05T07:49:15.960814+0000","last_clean":"2024-09-05T07:49:15.960814+0000","last_became_active":"2024-09-05T07:49:14.951505+0000","last_became_peered":"2024-09-05T07:49:14.951505+0000","last_unstale":"2024-09-05T07:49:15.960814+0000","last_undegraded":"2024-09-05T07:49:15.960814+0000","last_fullsized":"2024-09-05T07:49:15.960814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:51:03.739607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963924+0000","last_change":"2024-09-05T07:49:14.961668+0000","last_active":"2024-09-05T07:49:15.963924+0000","last_peered":"2024-09-05T07:49:15.963924+0000","last_clean":"2024-09-05T07:49:15.963924+0000","last_became_active":"2024-09-05T07:49:14.961161+0000","last_became_peered":"2024-09-05T07:49:14.961161+0000","last_unstale":"2024-09-05T07:49:15.963924+0000","last_undegraded":"2024-09-05T07:49:15.963924+0000","last_fullsized":"2024-09-05T07:49:15.963924+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:13:33.263713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947168+0000","last_change":"2024-09-05T07:49:14.955690+0000","last_active":"2024-09-05T07:49:15.947168+0000","last_peered":"2024-09-05T07:49:15.947168+0000","last_clean":"2024-09-05T07:49:15.947168+0000","last_became_active":"2024-09-05T07:49:14.955361+0000","last_became_peered":"2024-09-05T07:49:14.955361+0000","last_unstale":"2024-09-05T07:49:15.947168+0000","last_undegraded":"2024-09-05T07:49:15.947168+0000","last_fullsized":"2024-09-05T07:49:15.947168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:24.301568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947422+0000","last_change":"2024-09-05T07:49:14.949907+0000","last_active":"2024-09-05T07:49:15.947422+0000","last_peered":"2024-09-05T07:49:15.947422+0000","last_clean":"2024-09-05T07:49:15.947422+0000","last_became_active":"2024-09-05T07:49:14.949583+0000","last_became_peered":"2024-09-05T07:49:14.949583+0000","last_unstale":"2024-09-05T07:49:15.947422+0000","last_undegraded":"2024-09-05T07:49:15.947422+0000","last_fullsized":"2024-09-05T07:49:15.947422+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:42:38.342496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963375+0000","last_change":"2024-09-05T07:49:14.943501+0000","last_active":"2024-09-05T07:49:15.963375+0000","last_peered":"2024-09-05T07:49:15.963375+0000","last_clean":"2024-09-05T07:49:15.963375+0000","last_became_active":"2024-09-05T07:49:14.943184+0000","last_became_peered":"2024-09-05T07:49:14.943184+0000","last_unstale":"2024-09-05T07:49:15.963375+0000","last_undegraded":"2024-09-05T07:49:15.963375+0000","last_fullsized":"2024-09-05T07:49:15.963375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:11:30.840749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959120+0000","last_change":"2024-09-05T07:49:14.947161+0000","last_active":"2024-09-05T07:49:15.959120+0000","last_peered":"2024-09-05T07:49:15.959120+0000","last_clean":"2024-09-05T07:49:15.959120+0000","last_became_active":"2024-09-05T07:49:14.946830+0000","last_became_peered":"2024-09-05T07:49:14.946830+0000","last_unstale":"2024-09-05T07:49:15.959120+0000","last_undegraded":"2024-09-05T07:49:15.959120+0000","last_fullsized":"2024-09-05T07:49:15.959120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:24:03.193771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:43.386864+0000","last_change":"2024-09-05T07:49:12.623481+0000","last_active":"2024-09-05T07:49:43.386864+0000","last_peered":"2024-09-05T07:49:43.386864+0000","last_clean":"2024-09-05T07:49:43.386864+0000","last_became_active":"2024-09-05T07:49:12.623138+0000","last_became_peered":"2024-09-05T07:49:12.623138+0000","last_unstale":"2024-09-05T07:49:43.386864+0000","last_undegraded":"2024-09-05T07:49:43.386864+0000","last_fullsized":"2024-09-05T07:49:43.386864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:05:20.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.962534+0000","last_change":"2024-09-05T07:49:14.958574+0000","last_active":"2024-09-05T07:49:15.962534+0000","last_peered":"2024-09-05T07:49:15.962534+0000","last_clean":"2024-09-05T07:49:15.962534+0000","last_became_active":"2024-09-05T07:49:14.958240+0000","last_became_peered":"2024-09-05T07:49:14.958240+0000","last_unstale":"2024-09-05T07:49:15.962534+0000","last_undegraded":"2024-09-05T07:49:15.962534+0000","last_fullsized":"2024-09-05T07:49:15.962534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:50.616710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.346005+0000","last_change":"2024-09-05T07:49:12.622424+0000","last_active":"2024-09-05T07:49:26.346005+0000","last_peered":"2024-09-05T07:49:26.346005+0000","last_clean":"2024-09-05T07:49:26.346005+0000","last_became_active":"2024-09-05T07:49:12.622081+0000","last_became_peered":"2024-09-05T07:49:12.622081+0000","last_unstale":"2024-09-05T07:49:26.346005+0000","last_undegraded":"2024-09-05T07:49:26.346005+0000","last_fullsized":"2024-09-05T07:49:26.346005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:12.531564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:25.340111+0000","last_change":"2024-09-05T07:49:12.619623+0000","last_active":"2024-09-05T07:49:25.340111+0000","last_peered":"2024-09-05T07:49:25.340111+0000","last_clean":"2024-09-05T07:49:25.340111+0000","last_became_active":"2024-09-05T07:49:12.618756+0000","last_became_peered":"2024-09-05T07:49:12.618756+0000","last_unstale":"2024-09-05T07:49:25.340111+0000","last_undegraded":"2024-09-05T07:49:25.340111+0000","last_fullsized":"2024-09-05T07:49:25.340111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:57:55.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959570+0000","last_change":"2024-09-05T07:49:14.966157+0000","last_active":"2024-09-05T07:49:15.959570+0000","last_peered":"2024-09-05T07:49:15.959570+0000","last_clean":"2024-09-05T07:49:15.959570+0000","last_became_active":"2024-09-05T07:49:14.963557+0000","last_became_peered":"2024-09-05T07:49:14.963557+0000","last_unstale":"2024-09-05T07:49:15.959570+0000","last_undegraded":"2024-09-05T07:49:15.959570+0000","last_fullsized":"2024-09-05T07:49:15.959570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:17.900388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.354654+0000","last_change":"2024-09-05T07:49:12.620531+0000","last_active":"2024-09-05T07:49:27.354654+0000","last_peered":"2024-09-05T07:49:27.354654+0000","last_clean":"2024-09-05T07:49:27.354654+0000","last_became_active":"2024-09-05T07:49:12.620227+0000","last_became_peered":"2024-09-05T07:49:12.620227+0000","last_unstale":"2024-09-05T07:49:27.354654+0000","last_undegraded":"2024-09-05T07:49:27.354654+0000","last_fullsized":"2024-09-05T07:49:27.354654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:43.694290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946955+0000","last_change":"2024-09-05T07:49:14.964372+0000","last_active":"2024-09-05T07:49:15.946955+0000","last_peered":"2024-09-05T07:49:15.946955+0000","last_clean":"2024-09-05T07:49:15.946955+0000","last_became_active":"2024-09-05T07:49:14.964017+0000","last_became_peered":"2024-09-05T07:49:14.964017+0000","last_unstale":"2024-09-05T07:49:15.946955+0000","last_undegraded":"2024-09-05T07:49:15.946955+0000","last_fullsized":"2024-09-05T07:49:15.946955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:21:05.059035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.383628+0000","last_change":"2024-09-05T07:49:12.617764+0000","last_active":"2024-09-05T07:49:41.383628+0000","last_peered":"2024-09-05T07:49:41.383628+0000","last_clean":"2024-09-05T07:49:41.383628+0000","last_became_active":"2024-09-05T07:49:12.617362+0000","last_became_peered":"2024-09-05T07:49:12.617362+0000","last_unstale":"2024-09-05T07:49:41.383628+0000","last_undegraded":"2024-09-05T07:49:41.383628+0000","last_fullsized":"2024-09-05T07:49:41.383628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:27.291110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.948022+0000","last_change":"2024-09-05T07:49:14.946462+0000","last_active":"2024-09-05T07:49:15.948022+0000","last_peered":"2024-09-05T07:49:15.948022+0000","last_clean":"2024-09-05T07:49:15.948022+0000","last_became_active":"2024-09-05T07:49:14.946148+0000","last_became_peered":"2024-09-05T07:49:14.946148+0000","last_unstale":"2024-09-05T07:49:15.948022+0000","last_undegraded":"2024-09-05T07:49:15.948022+0000","last_fullsized":"2024-09-05T07:49:15.948022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:58.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355158+0000","last_change":"2024-09-05T07:49:12.624126+0000","last_active":"2024-09-05T07:49:27.355158+0000","last_peered":"2024-09-05T07:49:27.355158+0000","last_clean":"2024-09-05T07:49:27.355158+0000","last_became_active":"2024-09-05T07:49:12.623552+0000","last_became_peered":"2024-09-05T07:49:12.623552+0000","last_unstale":"2024-09-05T07:49:27.355158+0000","last_undegraded":"2024-09-05T07:49:27.355158+0000","last_fullsized":"2024-09-05T07:49:27.355158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:32.068841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964341+0000","last_change":"2024-09-05T07:49:14.953564+0000","last_active":"2024-09-05T07:49:15.964341+0000","last_peered":"2024-09-05T07:49:15.964341+0000","last_clean":"2024-09-05T07:49:15.964341+0000","last_became_active":"2024-09-05T07:49:14.953257+0000","last_became_peered":"2024-09-05T07:49:14.953257+0000","last_unstale":"2024-09-05T07:49:15.964341+0000","last_undegraded":"2024-09-05T07:49:15.964341+0000","last_fullsized":"2024-09-05T07:49:15.964341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:46.140705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.344037+0000","last_change":"2024-09-05T07:49:12.923484+0000","last_active":"2024-09-05T07:49:26.344037+0000","last_peered":"2024-09-05T07:49:26.344037+0000","last_clean":"2024-09-05T07:49:26.344037+0000","last_became_active":"2024-09-05T07:49:12.923039+0000","last_became_peered":"2024-09-05T07:49:12.923039+0000","last_unstale":"2024-09-05T07:49:26.344037+0000","last_undegraded":"2024-09-05T07:49:26.344037+0000","last_fullsized":"2024-09-05T07:49:26.344037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:25:32.918343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947737+0000","last_change":"2024-09-05T07:49:14.946368+0000","last_active":"2024-09-05T07:49:15.947737+0000","last_peered":"2024-09-05T07:49:15.947737+0000","last_clean":"2024-09-05T07:49:15.947737+0000","last_became_active":"2024-09-05T07:49:14.946023+0000","last_became_peered":"2024-09-05T07:49:14.946023+0000","last_unstale":"2024-09-05T07:49:15.947737+0000","last_undegraded":"2024-09-05T07:49:15.947737+0000","last_fullsized":"2024-09-05T07:49:15.947737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:27.579086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'24","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384957+0000","last_change":"2024-09-05T07:49:12.623923+0000","last_active":"2024-09-05T07:49:41.384957+0000","last_peered":"2024-09-05T07:49:41.384957+0000","last_clean":"2024-09-05T07:49:41.384957+0000","last_became_active":"2024-09-05T07:49:12.623559+0000","last_became_peered":"2024-09-05T07:49:12.623559+0000","last_unstale":"2024-09-05T07:49:41.384957+0000","last_undegraded":"2024-09-05T07:49:41.384957+0000","last_fullsized":"2024-09-05T07:49:41.384957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:10.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960149+0000","last_change":"2024-09-05T07:49:14.953936+0000","last_active":"2024-09-05T07:49:15.960149+0000","last_peered":"2024-09-05T07:49:15.960149+0000","last_clean":"2024-09-05T07:49:15.960149+0000","last_became_active":"2024-09-05T07:49:14.952830+0000","last_became_peered":"2024-09-05T07:49:14.952830+0000","last_unstale":"2024-09-05T07:49:15.960149+0000","last_undegraded":"2024-09-05T07:49:15.960149+0000","last_fullsized":"2024-09-05T07:49:15.960149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:26.907025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.360931+0000","last_change":"2024-09-05T07:49:12.623299+0000","last_active":"2024-09-05T07:49:28.360931+0000","last_peered":"2024-09-05T07:49:28.360931+0000","last_clean":"2024-09-05T07:49:28.360931+0000","last_became_active":"2024-09-05T07:49:12.622942+0000","last_became_peered":"2024-09-05T07:49:12.622942+0000","last_unstale":"2024-09-05T07:49:28.360931+0000","last_undegraded":"2024-09-05T07:49:28.360931+0000","last_fullsized":"2024-09-05T07:49:28.360931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:59:07.846104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.961405+0000","last_change":"2024-09-05T07:49:14.959269+0000","last_active":"2024-09-05T07:49:15.961405+0000","last_peered":"2024-09-05T07:49:15.961405+0000","last_clean":"2024-09-05T07:49:15.961405+0000","last_became_active":"2024-09-05T07:49:14.956838+0000","last_became_peered":"2024-09-05T07:49:14.956838+0000","last_unstale":"2024-09-05T07:49:15.961405+0000","last_undegraded":"2024-09-05T07:49:15.961405+0000","last_fullsized":"2024-09-05T07:49:15.961405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:40.047519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355545+0000","last_change":"2024-09-05T07:49:12.618068+0000","last_active":"2024-09-05T07:49:27.355545+0000","last_peered":"2024-09-05T07:49:27.355545+0000","last_clean":"2024-09-05T07:49:27.355545+0000","last_became_active":"2024-09-05T07:49:12.617125+0000","last_became_peered":"2024-09-05T07:49:12.617125+0000","last_unstale":"2024-09-05T07:49:27.355545+0000","last_undegraded":"2024-09-05T07:49:27.355545+0000","last_fullsized":"2024-09-05T07:49:27.355545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:39:50.999342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946994+0000","last_change":"2024-09-05T07:49:14.956131+0000","last_active":"2024-09-05T07:49:15.946994+0000","last_peered":"2024-09-05T07:49:15.946994+0000","last_clean":"2024-09-05T07:49:15.946994+0000","last_became_active":"2024-09-05T07:49:14.955817+0000","last_became_peered":"2024-09-05T07:49:14.955817+0000","last_unstale":"2024-09-05T07:49:15.946994+0000","last_undegraded":"2024-09-05T07:49:15.946994+0000","last_fullsized":"2024-09-05T07:49:15.946994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:14.800599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:39.381423+0000","last_change":"2024-09-05T07:49:12.620990+0000","last_active":"2024-09-05T07:49:39.381423+0000","last_peered":"2024-09-05T07:49:39.381423+0000","last_clean":"2024-09-05T07:49:39.381423+0000","last_became_active":"2024-09-05T07:49:12.620571+0000","last_became_peered":"2024-09-05T07:49:12.620571+0000","last_unstale":"2024-09-05T07:49:39.381423+0000","last_undegraded":"2024-09-05T07:49:39.381423+0000","last_fullsized":"2024-09-05T07:49:39.381423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:01.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946784+0000","last_change":"2024-09-05T07:49:14.954588+0000","last_active":"2024-09-05T07:49:15.946784+0000","last_peered":"2024-09-05T07:49:15.946784+0000","last_clean":"2024-09-05T07:49:15.946784+0000","last_became_active":"2024-09-05T07:49:14.954252+0000","last_became_peered":"2024-09-05T07:49:14.954252+0000","last_unstale":"2024-09-05T07:49:15.946784+0000","last_undegraded":"2024-09-05T07:49:15.946784+0000","last_fullsized":"2024-09-05T07:49:15.946784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:31.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355078+0000","last_change":"2024-09-05T07:49:12.922771+0000","last_active":"2024-09-05T07:49:27.355078+0000","last_peered":"2024-09-05T07:49:27.355078+0000","last_clean":"2024-09-05T07:49:27.355078+0000","last_became_active":"2024-09-05T07:49:12.922377+0000","last_became_peered":"2024-09-05T07:49:12.922377+0000","last_unstale":"2024-09-05T07:49:27.355078+0000","last_undegraded":"2024-09-05T07:49:27.355078+0000","last_fullsized":"2024-09-05T07:49:27.355078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:54.376164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963368+0000","last_change":"2024-09-05T07:49:14.954094+0000","last_active":"2024-09-05T07:49:15.963368+0000","last_peered":"2024-09-05T07:49:15.963368+0000","last_clean":"2024-09-05T07:49:15.963368+0000","last_became_active":"2024-09-05T07:49:14.953783+0000","last_became_peered":"2024-09-05T07:49:14.953783+0000","last_unstale":"2024-09-05T07:49:15.963368+0000","last_undegraded":"2024-09-05T07:49:15.963368+0000","last_fullsized":"2024-09-05T07:49:15.963368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:11.209443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.335132+0000","last_change":"2024-09-05T07:49:12.623690+0000","last_active":"2024-09-05T07:49:26.335132+0000","last_peered":"2024-09-05T07:49:26.335132+0000","last_clean":"2024-09-05T07:49:26.335132+0000","last_became_active":"2024-09-05T07:49:12.623315+0000","last_became_peered":"2024-09-05T07:49:12.623315+0000","last_unstale":"2024-09-05T07:49:26.335132+0000","last_undegraded":"2024-09-05T07:49:26.335132+0000","last_fullsized":"2024-09-05T07:49:26.335132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:01.293175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964105+0000","last_change":"2024-09-05T07:49:14.943190+0000","last_active":"2024-09-05T07:49:15.964105+0000","last_peered":"2024-09-05T07:49:15.964105+0000","last_clean":"2024-09-05T07:49:15.964105+0000","last_became_active":"2024-09-05T07:49:14.942863+0000","last_became_peered":"2024-09-05T07:49:14.942863+0000","last_unstale":"2024-09-05T07:49:15.964105+0000","last_undegraded":"2024-09-05T07:49:15.964105+0000","last_fullsized":"2024-09-05T07:49:15.964105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:54.401096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355343+0000","last_change":"2024-09-05T07:49:12.623328+0000","last_active":"2024-09-05T07:49:27.355343+0000","last_peered":"2024-09-05T07:49:27.355343+0000","last_clean":"2024-09-05T07:49:27.355343+0000","last_became_active":"2024-09-05T07:49:12.622993+0000","last_became_peered":"2024-09-05T07:49:12.622993+0000","last_unstale":"2024-09-05T07:49:27.355343+0000","last_undegraded":"2024-09-05T07:49:27.355343+0000","last_fullsized":"2024-09-05T07:49:27.355343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:11:27.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947462+0000","last_change":"2024-09-05T07:49:14.951250+0000","last_active":"2024-09-05T07:49:15.947462+0000","last_peered":"2024-09-05T07:49:15.947462+0000","last_clean":"2024-09-05T07:49:15.947462+0000","last_became_active":"2024-09-05T07:49:14.950834+0000","last_became_peered":"2024-09-05T07:49:14.950834+0000","last_unstale":"2024-09-05T07:49:15.947462+0000","last_undegraded":"2024-09-05T07:49:15.947462+0000","last_fullsized":"2024-09-05T07:49:15.947462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:42.992517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355485+0000","last_change":"2024-09-05T07:49:12.620555+0000","last_active":"2024-09-05T07:49:27.355485+0000","last_peered":"2024-09-05T07:49:27.355485+0000","last_clean":"2024-09-05T07:49:27.355485+0000","last_became_active":"2024-09-05T07:49:12.619847+0000","last_became_peered":"2024-09-05T07:49:12.619847+0000","last_unstale":"2024-09-05T07:49:27.355485+0000","last_undegraded":"2024-09-05T07:49:27.355485+0000","last_fullsized":"2024-09-05T07:49:27.355485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:18:59.833342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:18.036567+0000","last_change":"2024-09-05T07:49:14.952173+0000","last_active":"2024-09-05T07:49:18.036567+0000","last_peered":"2024-09-05T07:49:18.036567+0000","last_clean":"2024-09-05T07:49:18.036567+0000","last_became_active":"2024-09-05T07:49:14.951848+0000","last_became_peered":"2024-09-05T07:49:14.951848+0000","last_unstale":"2024-09-05T07:49:18.036567+0000","last_undegraded":"2024-09-05T07:49:18.036567+0000","last_fullsized":"2024-09-05T07:49:18.036567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384391+0000","last_change":"2024-09-05T07:49:12.923318+0000","last_active":"2024-09-05T07:49:41.384391+0000","last_peered":"2024-09-05T07:49:41.384391+0000","last_clean":"2024-09-05T07:49:41.384391+0000","last_became_active":"2024-09-05T07:49:12.922965+0000","last_became_peered":"2024-09-05T07:49:12.922965+0000","last_unstale":"2024-09-05T07:49:41.384391+0000","last_undegraded":"2024-09-05T07:49:41.384391+0000","last_fullsized":"2024-09-05T07:49:41.384391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:19.576198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947332+0000","last_change":"2024-09-05T07:49:14.950067+0000","last_active":"2024-09-05T07:49:15.947332+0000","last_peered":"2024-09-05T07:49:15.947332+0000","last_clean":"2024-09-05T07:49:15.947332+0000","last_became_active":"2024-09-05T07:49:14.949580+0000","last_became_peered":"2024-09-05T07:49:14.949580+0000","last_unstale":"2024-09-05T07:49:15.947332+0000","last_undegraded":"2024-09-05T07:49:15.947332+0000","last_fullsized":"2024-09-05T07:49:15.947332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:08.754476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946978+0000","last_change":"2024-09-05T07:47:54.520597+0000","last_active":"2024-09-05T07:49:15.946978+0000","last_peered":"2024-09-05T07:49:15.946978+0000","last_clean":"2024-09-05T07:49:15.946978+0000","last_became_active":"2024-09-05T07:47:54.520187+0000","last_became_peered":"2024-09-05T07:47:54.520187+0000","last_unstale":"2024-09-05T07:49:15.946978+0000","last_undegraded":"2024-09-05T07:49:15.946978+0000","last_fullsized":"2024-09-05T07:49:15.946978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_clean_scrub_stamp":"2024-09-05T07:44:23.832394+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:19.382482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.362473+0000","last_change":"2024-09-05T07:49:12.618142+0000","last_active":"2024-09-05T07:49:28.362473+0000","last_peered":"2024-09-05T07:49:28.362473+0000","last_clean":"2024-09-05T07:49:28.362473+0000","last_became_active":"2024-09-05T07:49:12.617799+0000","last_became_peered":"2024-09-05T07:49:12.617799+0000","last_unstale":"2024-09-05T07:49:28.362473+0000","last_undegraded":"2024-09-05T07:49:28.362473+0000","last_fullsized":"2024-09-05T07:49:28.362473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:34:55.843402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960067+0000","last_change":"2024-09-05T07:49:14.962066+0000","last_active":"2024-09-05T07:49:15.960067+0000","last_peered":"2024-09-05T07:49:15.960067+0000","last_clean":"2024-09-05T07:49:15.960067+0000","last_became_active":"2024-09-05T07:49:14.952793+0000","last_became_peered":"2024-09-05T07:49:14.952793+0000","last_unstale":"2024-09-05T07:49:15.960067+0000","last_undegraded":"2024-09-05T07:49:15.960067+0000","last_fullsized":"2024-09-05T07:49:15.960067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:53.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:25.339286+0000","last_change":"2024-09-05T07:49:12.624350+0000","last_active":"2024-09-05T07:49:25.339286+0000","last_peered":"2024-09-05T07:49:25.339286+0000","last_clean":"2024-09-05T07:49:25.339286+0000","last_became_active":"2024-09-05T07:49:12.623907+0000","last_became_peered":"2024-09-05T07:49:12.623907+0000","last_unstale":"2024-09-05T07:49:25.339286+0000","last_undegraded":"2024-09-05T07:49:25.339286+0000","last_fullsized":"2024-09-05T07:49:25.339286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.663789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959752+0000","last_change":"2024-09-05T07:49:14.953372+0000","last_active":"2024-09-05T07:49:15.959752+0000","last_peered":"2024-09-05T07:49:15.959752+0000","last_clean":"2024-09-05T07:49:15.959752+0000","last_became_active":"2024-09-05T07:49:14.952986+0000","last_became_peered":"2024-09-05T07:49:14.952986+0000","last_unstale":"2024-09-05T07:49:15.959752+0000","last_undegraded":"2024-09-05T07:49:15.959752+0000","last_fullsized":"2024-09-05T07:49:15.959752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:01:55.338289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.383369+0000","last_change":"2024-09-05T07:49:12.923463+0000","last_active":"2024-09-05T07:49:41.383369+0000","last_peered":"2024-09-05T07:49:41.383369+0000","last_clean":"2024-09-05T07:49:41.383369+0000","last_became_active":"2024-09-05T07:49:12.923105+0000","last_became_peered":"2024-09-05T07:49:12.923105+0000","last_unstale":"2024-09-05T07:49:41.383369+0000","last_undegraded":"2024-09-05T07:49:41.383369+0000","last_fullsized":"2024-09-05T07:49:41.383369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:25:21.795954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959179+0000","last_change":"2024-09-05T07:49:14.951796+0000","last_active":"2024-09-05T07:49:15.959179+0000","last_peered":"2024-09-05T07:49:15.959179+0000","last_clean":"2024-09-05T07:49:15.959179+0000","last_became_active":"2024-09-05T07:49:14.951450+0000","last_became_peered":"2024-09-05T07:49:14.951450+0000","last_unstale":"2024-09-05T07:49:15.959179+0000","last_undegraded":"2024-09-05T07:49:15.959179+0000","last_fullsized":"2024-09-05T07:49:15.959179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:52.755044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384036+0000","last_change":"2024-09-05T07:49:12.618510+0000","last_active":"2024-09-05T07:49:41.384036+0000","last_peered":"2024-09-05T07:49:41.384036+0000","last_clean":"2024-09-05T07:49:41.384036+0000","last_became_active":"2024-09-05T07:49:12.618160+0000","last_became_peered":"2024-09-05T07:49:12.618160+0000","last_unstale":"2024-09-05T07:49:41.384036+0000","last_undegraded":"2024-09-05T07:49:41.384036+0000","last_fullsized":"2024-09-05T07:49:41.384036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:52:12.432287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959910+0000","last_change":"2024-09-05T07:49:14.953989+0000","last_active":"2024-09-05T07:49:15.959910+0000","last_peered":"2024-09-05T07:49:15.959910+0000","last_clean":"2024-09-05T07:49:15.959910+0000","last_became_active":"2024-09-05T07:49:14.953651+0000","last_became_peered":"2024-09-05T07:49:14.953651+0000","last_unstale":"2024-09-05T07:49:15.959910+0000","last_undegraded":"2024-09-05T07:49:15.959910+0000","last_fullsized":"2024-09-05T07:49:15.959910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:36.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946960+0000","last_change":"2024-09-05T07:49:12.923661+0000","last_active":"2024-09-05T07:49:15.946960+0000","last_peered":"2024-09-05T07:49:15.946960+0000","last_clean":"2024-09-05T07:49:15.946960+0000","last_became_active":"2024-09-05T07:49:12.923273+0000","last_became_peered":"2024-09-05T07:49:12.923273+0000","last_unstale":"2024-09-05T07:49:15.946960+0000","last_undegraded":"2024-09-05T07:49:15.946960+0000","last_fullsized":"2024-09-05T07:49:15.946960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:08.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:17.350512+0000","last_change":"2024-09-05T07:49:14.964797+0000","last_active":"2024-09-05T07:49:17.350512+0000","last_peered":"2024-09-05T07:49:17.350512+0000","last_clean":"2024-09-05T07:49:17.350512+0000","last_became_active":"2024-09-05T07:49:14.964411+0000","last_became_peered":"2024-09-05T07:49:14.964411+0000","last_unstale":"2024-09-05T07:49:17.350512+0000","last_undegraded":"2024-09-05T07:49:17.350512+0000","last_fullsized":"2024-09-05T07:49:17.350512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:55:37.150270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355321+0000","last_change":"2024-09-05T07:49:12.924896+0000","last_active":"2024-09-05T07:49:27.355321+0000","last_peered":"2024-09-05T07:49:27.355321+0000","last_clean":"2024-09-05T07:49:27.355321+0000","last_became_active":"2024-09-05T07:49:12.924556+0000","last_became_peered":"2024-09-05T07:49:12.924556+0000","last_unstale":"2024-09-05T07:49:27.355321+0000","last_undegraded":"2024-09-05T07:49:27.355321+0000","last_fullsized":"2024-09-05T07:49:27.355321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:02:37.433963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960955+0000","last_change":"2024-09-05T07:49:14.953635+0000","last_active":"2024-09-05T07:49:15.960955+0000","last_peered":"2024-09-05T07:49:15.960955+0000","last_clean":"2024-09-05T07:49:15.960955+0000","last_became_active":"2024-09-05T07:49:14.950967+0000","last_became_peered":"2024-09-05T07:49:14.950967+0000","last_unstale":"2024-09-05T07:49:15.960955+0000","last_undegraded":"2024-09-05T07:49:15.960955+0000","last_fullsized":"2024-09-05T07:49:15.960955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:20:47.539927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:38.959270+0000","last_change":"2024-09-05T07:49:12.621601+0000","last_active":"2024-09-05T07:49:38.959270+0000","last_peered":"2024-09-05T07:49:38.959270+0000","last_clean":"2024-09-05T07:49:38.959270+0000","last_became_active":"2024-09-05T07:49:12.621285+0000","last_became_peered":"2024-09-05T07:49:12.621285+0000","last_unstale":"2024-09-05T07:49:38.959270+0000","last_undegraded":"2024-09-05T07:49:38.959270+0000","last_fullsized":"2024-09-05T07:49:38.959270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:54:28.216480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960594+0000","last_change":"2024-09-05T07:49:14.963083+0000","last_active":"2024-09-05T07:49:15.960594+0000","last_peered":"2024-09-05T07:49:15.960594+0000","last_clean":"2024-09-05T07:49:15.960594+0000","last_became_active":"2024-09-05T07:49:14.962763+0000","last_became_peered":"2024-09-05T07:49:14.962763+0000","last_unstale":"2024-09-05T07:49:15.960594+0000","last_undegraded":"2024-09-05T07:49:15.960594+0000","last_fullsized":"2024-09-05T07:49:15.960594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:41.475517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.356138+0000","last_change":"2024-09-05T07:49:12.630250+0000","last_active":"2024-09-05T07:49:27.356138+0000","last_peered":"2024-09-05T07:49:27.356138+0000","last_clean":"2024-09-05T07:49:27.356138+0000","last_became_active":"2024-09-05T07:49:12.629953+0000","last_became_peered":"2024-09-05T07:49:12.629953+0000","last_unstale":"2024-09-05T07:49:27.356138+0000","last_undegraded":"2024-09-05T07:49:27.356138+0000","last_fullsized":"2024-09-05T07:49:27.356138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:30:26.217587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964337+0000","last_change":"2024-09-05T07:49:14.965623+0000","last_active":"2024-09-05T07:49:15.964337+0000","last_peered":"2024-09-05T07:49:15.964337+0000","last_clean":"2024-09-05T07:49:15.964337+0000","last_became_active":"2024-09-05T07:49:14.964544+0000","last_became_peered":"2024-09-05T07:49:14.964544+0000","last_unstale":"2024-09-05T07:49:15.964337+0000","last_undegraded":"2024-09-05T07:49:15.964337+0000","last_fullsized":"2024-09-05T07:49:15.964337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:03:51.723187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:24.325855+0000","last_change":"2024-09-05T07:49:12.922943+0000","last_active":"2024-09-05T07:49:24.325855+0000","last_peered":"2024-09-05T07:49:24.325855+0000","last_clean":"2024-09-05T07:49:24.325855+0000","last_became_active":"2024-09-05T07:49:12.922553+0000","last_became_peered":"2024-09-05T07:49:12.922553+0000","last_unstale":"2024-09-05T07:49:24.325855+0000","last_undegraded":"2024-09-05T07:49:24.325855+0000","last_fullsized":"2024-09-05T07:49:24.325855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:08:39.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959030+0000","last_change":"2024-09-05T07:49:14.950904+0000","last_active":"2024-09-05T07:49:15.959030+0000","last_peered":"2024-09-05T07:49:15.959030+0000","last_clean":"2024-09-05T07:49:15.959030+0000","last_became_active":"2024-09-05T07:49:14.950553+0000","last_became_peered":"2024-09-05T07:49:14.950553+0000","last_unstale":"2024-09-05T07:49:15.959030+0000","last_undegraded":"2024-09-05T07:49:15.959030+0000","last_fullsized":"2024-09-05T07:49:15.959030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:31:35.255414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.353918+0000","last_change":"2024-09-05T07:49:12.617926+0000","last_active":"2024-09-05T07:49:27.353918+0000","last_peered":"2024-09-05T07:49:27.353918+0000","last_clean":"2024-09-05T07:49:27.353918+0000","last_became_active":"2024-09-05T07:49:12.617168+0000","last_became_peered":"2024-09-05T07:49:12.617168+0000","last_unstale":"2024-09-05T07:49:27.353918+0000","last_undegraded":"2024-09-05T07:49:27.353918+0000","last_fullsized":"2024-09-05T07:49:27.353918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:24.934339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963604+0000","last_change":"2024-09-05T07:49:14.951658+0000","last_active":"2024-09-05T07:49:15.963604+0000","last_peered":"2024-09-05T07:49:15.963604+0000","last_clean":"2024-09-05T07:49:15.963604+0000","last_became_active":"2024-09-05T07:49:14.951328+0000","last_became_peered":"2024-09-05T07:49:14.951328+0000","last_unstale":"2024-09-05T07:49:15.963604+0000","last_undegraded":"2024-09-05T07:49:15.963604+0000","last_fullsized":"2024-09-05T07:49:15.963604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:30:06.429805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.345714+0000","last_change":"2024-09-05T07:49:12.626227+0000","last_active":"2024-09-05T07:49:26.345714+0000","last_peered":"2024-09-05T07:49:26.345714+0000","last_clean":"2024-09-05T07:49:26.345714+0000","last_became_active":"2024-09-05T07:49:12.625440+0000","last_became_peered":"2024-09-05T07:49:12.625440+0000","last_unstale":"2024-09-05T07:49:26.345714+0000","last_undegraded":"2024-09-05T07:49:26.345714+0000","last_fullsized":"2024-09-05T07:49:26.345714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:26:37.874247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960273+0000","last_change":"2024-09-05T07:49:14.963017+0000","last_active":"2024-09-05T07:49:15.960273+0000","last_peered":"2024-09-05T07:49:15.960273+0000","last_clean":"2024-09-05T07:49:15.960273+0000","last_became_active":"2024-09-05T07:49:14.962655+0000","last_became_peered":"2024-09-05T07:49:14.962655+0000","last_unstale":"2024-09-05T07:49:15.960273+0000","last_undegraded":"2024-09-05T07:49:15.960273+0000","last_fullsized":"2024-09-05T07:49:15.960273+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:59.068930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:24.326985+0000","last_change":"2024-09-05T07:49:12.624658+0000","last_active":"2024-09-05T07:49:24.326985+0000","last_peered":"2024-09-05T07:49:24.326985+0000","last_clean":"2024-09-05T07:49:24.326985+0000","last_became_active":"2024-09-05T07:49:12.624301+0000","last_became_peered":"2024-09-05T07:49:12.624301+0000","last_unstale":"2024-09-05T07:49:24.326985+0000","last_undegraded":"2024-09-05T07:49:24.326985+0000","last_fullsized":"2024-09-05T07:49:24.326985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:15:14.941108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947406+0000","last_change":"2024-09-05T07:49:14.953562+0000","last_active":"2024-09-05T07:49:15.947406+0000","last_peered":"2024-09-05T07:49:15.947406+0000","last_clean":"2024-09-05T07:49:15.947406+0000","last_became_active":"2024-09-05T07:49:14.953242+0000","last_became_peered":"2024-09-05T07:49:14.953242+0000","last_unstale":"2024-09-05T07:49:15.947406+0000","last_undegraded":"2024-09-05T07:49:15.947406+0000","last_fullsized":"2024-09-05T07:49:15.947406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:02.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959614+0000","last_change":"2024-09-05T07:49:14.955497+0000","last_active":"2024-09-05T07:49:15.959614+0000","last_peered":"2024-09-05T07:49:15.959614+0000","last_clean":"2024-09-05T07:49:15.959614+0000","last_became_active":"2024-09-05T07:49:14.955138+0000","last_became_peered":"2024-09-05T07:49:14.955138+0000","last_unstale":"2024-09-05T07:49:15.959614+0000","last_undegraded":"2024-09-05T07:49:15.959614+0000","last_fullsized":"2024-09-05T07:49:15.959614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:17:17.869062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355088+0000","last_change":"2024-09-05T07:49:12.624583+0000","last_active":"2024-09-05T07:49:27.355088+0000","last_peered":"2024-09-05T07:49:27.355088+0000","last_clean":"2024-09-05T07:49:27.355088+0000","last_became_active":"2024-09-05T07:49:12.624184+0000","last_became_peered":"2024-09-05T07:49:12.624184+0000","last_unstale":"2024-09-05T07:49:27.355088+0000","last_undegraded":"2024-09-05T07:49:27.355088+0000","last_fullsized":"2024-09-05T07:49:27.355088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:46:33.137089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947697+0000","last_change":"2024-09-05T07:49:14.955735+0000","last_active":"2024-09-05T07:49:15.947697+0000","last_peered":"2024-09-05T07:49:15.947697+0000","last_clean":"2024-09-05T07:49:15.947697+0000","last_became_active":"2024-09-05T07:49:14.955388+0000","last_became_peered":"2024-09-05T07:49:14.955388+0000","last_unstale":"2024-09-05T07:49:15.947697+0000","last_undegraded":"2024-09-05T07:49:15.947697+0000","last_fullsized":"2024-09-05T07:49:15.947697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:07:15.436676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.360757+0000","last_change":"2024-09-05T07:49:12.627580+0000","last_active":"2024-09-05T07:49:28.360757+0000","last_peered":"2024-09-05T07:49:28.360757+0000","last_clean":"2024-09-05T07:49:28.360757+0000","last_became_active":"2024-09-05T07:49:12.627127+0000","last_became_peered":"2024-09-05T07:49:12.627127+0000","last_unstale":"2024-09-05T07:49:28.360757+0000","last_undegraded":"2024-09-05T07:49:28.360757+0000","last_fullsized":"2024-09-05T07:49:28.360757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:06.903093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964322+0000","last_change":"2024-09-05T07:49:14.952234+0000","last_active":"2024-09-05T07:49:15.964322+0000","last_peered":"2024-09-05T07:49:15.964322+0000","last_clean":"2024-09-05T07:49:15.964322+0000","last_became_active":"2024-09-05T07:49:14.948805+0000","last_became_peered":"2024-09-05T07:49:14.948805+0000","last_unstale":"2024-09-05T07:49:15.964322+0000","last_undegraded":"2024-09-05T07:49:15.964322+0000","last_fullsized":"2024-09-05T07:49:15.964322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:49.101303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.967017+0000","last_change":"2024-09-05T07:49:12.922749+0000","last_active":"2024-09-05T07:49:15.967017+0000","last_peered":"2024-09-05T07:49:15.967017+0000","last_clean":"2024-09-05T07:49:15.967017+0000","last_became_active":"2024-09-05T07:49:12.922415+0000","last_became_peered":"2024-09-05T07:49:12.922415+0000","last_unstale":"2024-09-05T07:49:15.967017+0000","last_undegraded":"2024-09-05T07:49:15.967017+0000","last_fullsized":"2024-09-05T07:49:15.967017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:19:58.163647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959992+0000","last_change":"2024-09-05T07:49:14.957792+0000","last_active":"2024-09-05T07:49:15.959992+0000","last_peered":"2024-09-05T07:49:15.959992+0000","last_clean":"2024-09-05T07:49:15.959992+0000","last_became_active":"2024-09-05T07:49:14.957312+0000","last_became_peered":"2024-09-05T07:49:14.957312+0000","last_unstale":"2024-09-05T07:49:15.959992+0000","last_undegraded":"2024-09-05T07:49:15.959992+0000","last_fullsized":"2024-09-05T07:49:15.959992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:55:17.422990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:40.382154+0000","last_change":"2024-09-05T07:49:12.621834+0000","last_active":"2024-09-05T07:49:40.382154+0000","last_peered":"2024-09-05T07:49:40.382154+0000","last_clean":"2024-09-05T07:49:40.382154+0000","last_became_active":"2024-09-05T07:49:12.621446+0000","last_became_peered":"2024-09-05T07:49:12.621446+0000","last_unstale":"2024-09-05T07:49:40.382154+0000","last_undegraded":"2024-09-05T07:49:40.382154+0000","last_fullsized":"2024-09-05T07:49:40.382154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:32.790982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":184,"num_read_kb":152,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":170852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282052,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481811,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":430631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1068855,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874268,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":430561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":430939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364840,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1024245,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528366,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":430671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1023137,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953527,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":430532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":430103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":478606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":486029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":431617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:49:46.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T07:49:46.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:46 smithi144 ceph-mon[29535]: pgmap v303: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-05T07:49:46.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:46 smithi144 ceph-mon[29535]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:46 smithi154 ceph-mon[34710]: pgmap v303: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-05T07:49:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:46 smithi154 ceph-mon[34710]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:46.719 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:46 smithi175 ceph-mon[34585]: pgmap v303: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-05T07:49:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:46 smithi175 ceph-mon[34585]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 -- 172.21.15.144:0/2138881380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c103ff0 msgr2=0x7efd0c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 --2- 172.21.15.144:0/2138881380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c103ff0 0x7efd0c1043d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009900 tx=0x7efcfc02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 -- 172.21.15.144:0/2138881380 shutdown_connections 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 --2- 172.21.15.144:0/2138881380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c1049a0 0x7efd0c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 --2- 172.21.15.144:0/2138881380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 0x7efd0c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 --2- 172.21.15.144:0/2138881380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c103ff0 0x7efd0c1043d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 -- 172.21.15.144:0/2138881380 >> 172.21.15.144:0/2138881380 conn(0x7efd0c0ffa90 msgr2=0x7efd0c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 -- 172.21.15.144:0/2138881380 shutdown_connections 2024-09-05T07:49:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.295+0000 7efd12800640 1 -- 172.21.15.144:0/2138881380 wait complete. 2024-09-05T07:49:47.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 Processor -- start 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 -- start start 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c103ff0 0x7efd0c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 0x7efd0c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c114120 con 0x7efd0c109120 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c113fa0 con 0x7efd0c103ff0 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.296+0000 7efd12800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1142a0 con 0x7efd0c1049a0 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:50244/0 (socket says 172.21.15.144:50244) 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 -- 172.21.15.144:0/4209494785 learned_addr learned my addr 172.21.15.144:0/4209494785 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0b400640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c103ff0 0x7efd0c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0be00640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 0x7efd0c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 -- 172.21.15.144:0/4209494785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c103ff0 msgr2=0x7efd0c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c103ff0 0x7efd0c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 -- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 msgr2=0x7efd0c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 0x7efd0c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.297+0000 7efd0aa00640 1 -- 172.21.15.144:0/4209494785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c19f590 con 0x7efd0c1049a0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd0aa00640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e9f0 tx=0x7efcf800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf800cd80 con 0x7efd0c1049a0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf8010910 con 0x7efd0c1049a0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c19f880 con 0x7efd0c1049a0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8018990 con 0x7efd0c1049a0 2024-09-05T07:49:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.298+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c1a7160 con 0x7efd0c1049a0 2024-09-05T07:49:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.299+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c1043d0 con 0x7efd0c1049a0 2024-09-05T07:49:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.301+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efcf8010ac0 con 0x7efd0c1049a0 2024-09-05T07:49:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.302+0000 7efd03e00640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 0x7efcf00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.302+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7efcf80cf390 con 0x7efd0c1049a0 2024-09-05T07:49:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.302+0000 7efd0b400640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 0x7efcf00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.303+0000 7efd0b400640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 0x7efcf00a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009230 tx=0x7efcfc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.310+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcf809bbf0 con 0x7efd0c1049a0 2024-09-05T07:49:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.491+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd0c062630 con 0x7efcf00a2c90 2024-09-05T07:49:47.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.499+0000 7efd03e00640 1 -- 172.21.15.144:0/4209494785 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258912 (secure 0 0 0) 0x7efd0c062630 con 0x7efcf00a2c90 2024-09-05T07:49:47.502 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:47.503 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-05T07:49:47.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 msgr2=0x7efcf00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 0x7efcf00a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009230 tx=0x7efcfc0058d0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 msgr2=0x7efd0c19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e9f0 tx=0x7efcf800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 shutdown_connections 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efcf00a2c90 0x7efcf00a5150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd0c109120 0x7efd0c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c1049a0 0x7efd0c19ab20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 --2- 172.21.15.144:0/4209494785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd0c103ff0 0x7efd0c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 >> 172.21.15.144:0/4209494785 conn(0x7efd0c0ffa90 msgr2=0x7efd0c100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 shutdown_connections 2024-09-05T07:49:47.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:47.504+0000 7efd12800640 1 -- 172.21.15.144:0/4209494785 wait complete. 2024-09-05T07:49:48.233 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-05T07:49:47.248190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":320,"num_read_kb":266,"num_write":421,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368724,"kb_used_data":11156,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573100,"statfs":{"total":1151940427776,"available":1151562854400,"internally_reserved":0,"allocated":11423744,"data_stored":7095926,"data_compressed":107619,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39215,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":102,"num_write":29,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003157"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964456+0000","last_change":"2024-09-05T07:49:14.951174+0000","last_active":"2024-09-05T07:49:15.964456+0000","last_peered":"2024-09-05T07:49:15.964456+0000","last_clean":"2024-09-05T07:49:15.964456+0000","last_became_active":"2024-09-05T07:49:14.950781+0000","last_became_peered":"2024-09-05T07:49:14.950781+0000","last_unstale":"2024-09-05T07:49:15.964456+0000","last_undegraded":"2024-09-05T07:49:15.964456+0000","last_fullsized":"2024-09-05T07:49:15.964456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:15.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964078+0000","last_change":"2024-09-05T07:49:14.948936+0000","last_active":"2024-09-05T07:49:15.964078+0000","last_peered":"2024-09-05T07:49:15.964078+0000","last_clean":"2024-09-05T07:49:15.964078+0000","last_became_active":"2024-09-05T07:49:14.948531+0000","last_became_peered":"2024-09-05T07:49:14.948531+0000","last_unstale":"2024-09-05T07:49:15.964078+0000","last_undegraded":"2024-09-05T07:49:15.964078+0000","last_fullsized":"2024-09-05T07:49:15.964078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:42:22.735935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963916+0000","last_change":"2024-09-05T07:49:14.948848+0000","last_active":"2024-09-05T07:49:15.963916+0000","last_peered":"2024-09-05T07:49:15.963916+0000","last_clean":"2024-09-05T07:49:15.963916+0000","last_became_active":"2024-09-05T07:49:14.948581+0000","last_became_peered":"2024-09-05T07:49:14.948581+0000","last_unstale":"2024-09-05T07:49:15.963916+0000","last_undegraded":"2024-09-05T07:49:15.963916+0000","last_fullsized":"2024-09-05T07:49:15.963916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:53:22.517299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960424+0000","last_change":"2024-09-05T07:49:14.950833+0000","last_active":"2024-09-05T07:49:15.960424+0000","last_peered":"2024-09-05T07:49:15.960424+0000","last_clean":"2024-09-05T07:49:15.960424+0000","last_became_active":"2024-09-05T07:49:14.949905+0000","last_became_peered":"2024-09-05T07:49:14.949905+0000","last_unstale":"2024-09-05T07:49:15.960424+0000","last_undegraded":"2024-09-05T07:49:15.960424+0000","last_fullsized":"2024-09-05T07:49:15.960424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:29:37.999531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959721+0000","last_change":"2024-09-05T07:49:14.957903+0000","last_active":"2024-09-05T07:49:15.959721+0000","last_peered":"2024-09-05T07:49:15.959721+0000","last_clean":"2024-09-05T07:49:15.959721+0000","last_became_active":"2024-09-05T07:49:14.957559+0000","last_became_peered":"2024-09-05T07:49:14.957559+0000","last_unstale":"2024-09-05T07:49:15.959721+0000","last_undegraded":"2024-09-05T07:49:15.959721+0000","last_fullsized":"2024-09-05T07:49:15.959721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:50.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.958914+0000","last_change":"2024-09-05T07:49:14.951216+0000","last_active":"2024-09-05T07:49:15.958914+0000","last_peered":"2024-09-05T07:49:15.958914+0000","last_clean":"2024-09-05T07:49:15.958914+0000","last_became_active":"2024-09-05T07:49:14.950518+0000","last_became_peered":"2024-09-05T07:49:14.950518+0000","last_unstale":"2024-09-05T07:49:15.958914+0000","last_undegraded":"2024-09-05T07:49:15.958914+0000","last_fullsized":"2024-09-05T07:49:15.958914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:05.373083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947321+0000","last_change":"2024-09-05T07:49:14.952832+0000","last_active":"2024-09-05T07:49:15.947321+0000","last_peered":"2024-09-05T07:49:15.947321+0000","last_clean":"2024-09-05T07:49:15.947321+0000","last_became_active":"2024-09-05T07:49:14.952470+0000","last_became_peered":"2024-09-05T07:49:14.952470+0000","last_unstale":"2024-09-05T07:49:15.947321+0000","last_undegraded":"2024-09-05T07:49:15.947321+0000","last_fullsized":"2024-09-05T07:49:15.947321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:01.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959495+0000","last_change":"2024-09-05T07:49:14.958144+0000","last_active":"2024-09-05T07:49:15.959495+0000","last_peered":"2024-09-05T07:49:15.959495+0000","last_clean":"2024-09-05T07:49:15.959495+0000","last_became_active":"2024-09-05T07:49:14.957851+0000","last_became_peered":"2024-09-05T07:49:14.957851+0000","last_unstale":"2024-09-05T07:49:15.959495+0000","last_undegraded":"2024-09-05T07:49:15.959495+0000","last_fullsized":"2024-09-05T07:49:15.959495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:49:37.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947984+0000","last_change":"2024-09-05T07:49:14.954599+0000","last_active":"2024-09-05T07:49:15.947984+0000","last_peered":"2024-09-05T07:49:15.947984+0000","last_clean":"2024-09-05T07:49:15.947984+0000","last_became_active":"2024-09-05T07:49:14.954241+0000","last_became_peered":"2024-09-05T07:49:14.954241+0000","last_unstale":"2024-09-05T07:49:15.947984+0000","last_undegraded":"2024-09-05T07:49:15.947984+0000","last_fullsized":"2024-09-05T07:49:15.947984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.657195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959596+0000","last_change":"2024-09-05T07:49:14.948803+0000","last_active":"2024-09-05T07:49:15.959596+0000","last_peered":"2024-09-05T07:49:15.959596+0000","last_clean":"2024-09-05T07:49:15.959596+0000","last_became_active":"2024-09-05T07:49:14.948388+0000","last_became_peered":"2024-09-05T07:49:14.948388+0000","last_unstale":"2024-09-05T07:49:15.959596+0000","last_undegraded":"2024-09-05T07:49:15.959596+0000","last_fullsized":"2024-09-05T07:49:15.959596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.867734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947166+0000","last_change":"2024-09-05T07:49:14.955055+0000","last_active":"2024-09-05T07:49:15.947166+0000","last_peered":"2024-09-05T07:49:15.947166+0000","last_clean":"2024-09-05T07:49:15.947166+0000","last_became_active":"2024-09-05T07:49:14.954758+0000","last_became_peered":"2024-09-05T07:49:14.954758+0000","last_unstale":"2024-09-05T07:49:15.947166+0000","last_undegraded":"2024-09-05T07:49:15.947166+0000","last_fullsized":"2024-09-05T07:49:15.947166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:52.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960604+0000","last_change":"2024-09-05T07:49:14.947590+0000","last_active":"2024-09-05T07:49:15.960604+0000","last_peered":"2024-09-05T07:49:15.960604+0000","last_clean":"2024-09-05T07:49:15.960604+0000","last_became_active":"2024-09-05T07:49:14.947097+0000","last_became_peered":"2024-09-05T07:49:14.947097+0000","last_unstale":"2024-09-05T07:49:15.960604+0000","last_undegraded":"2024-09-05T07:49:15.960604+0000","last_fullsized":"2024-09-05T07:49:15.960604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:01.318442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.961184+0000","last_change":"2024-09-05T07:49:14.947195+0000","last_active":"2024-09-05T07:49:15.961184+0000","last_peered":"2024-09-05T07:49:15.961184+0000","last_clean":"2024-09-05T07:49:15.961184+0000","last_became_active":"2024-09-05T07:49:14.946874+0000","last_became_peered":"2024-09-05T07:49:14.946874+0000","last_unstale":"2024-09-05T07:49:15.961184+0000","last_undegraded":"2024-09-05T07:49:15.961184+0000","last_fullsized":"2024-09-05T07:49:15.961184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:08.582375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963657+0000","last_change":"2024-09-05T07:49:14.948203+0000","last_active":"2024-09-05T07:49:15.963657+0000","last_peered":"2024-09-05T07:49:15.963657+0000","last_clean":"2024-09-05T07:49:15.963657+0000","last_became_active":"2024-09-05T07:49:14.947748+0000","last_became_peered":"2024-09-05T07:49:14.947748+0000","last_unstale":"2024-09-05T07:49:15.963657+0000","last_undegraded":"2024-09-05T07:49:15.963657+0000","last_fullsized":"2024-09-05T07:49:15.963657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963556+0000","last_change":"2024-09-05T07:49:14.954176+0000","last_active":"2024-09-05T07:49:15.963556+0000","last_peered":"2024-09-05T07:49:15.963556+0000","last_clean":"2024-09-05T07:49:15.963556+0000","last_became_active":"2024-09-05T07:49:14.952078+0000","last_became_peered":"2024-09-05T07:49:14.952078+0000","last_unstale":"2024-09-05T07:49:15.963556+0000","last_undegraded":"2024-09-05T07:49:15.963556+0000","last_fullsized":"2024-09-05T07:49:15.963556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:38:10.311444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946774+0000","last_change":"2024-09-05T07:49:14.958096+0000","last_active":"2024-09-05T07:49:15.946774+0000","last_peered":"2024-09-05T07:49:15.946774+0000","last_clean":"2024-09-05T07:49:15.946774+0000","last_became_active":"2024-09-05T07:49:14.957219+0000","last_became_peered":"2024-09-05T07:49:14.957219+0000","last_unstale":"2024-09-05T07:49:15.946774+0000","last_undegraded":"2024-09-05T07:49:15.946774+0000","last_fullsized":"2024-09-05T07:49:15.946774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:20.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964493+0000","last_change":"2024-09-05T07:49:14.950844+0000","last_active":"2024-09-05T07:49:15.964493+0000","last_peered":"2024-09-05T07:49:15.964493+0000","last_clean":"2024-09-05T07:49:15.964493+0000","last_became_active":"2024-09-05T07:49:14.950423+0000","last_became_peered":"2024-09-05T07:49:14.950423+0000","last_unstale":"2024-09-05T07:49:15.964493+0000","last_undegraded":"2024-09-05T07:49:15.964493+0000","last_fullsized":"2024-09-05T07:49:15.964493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:53.633531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947086+0000","last_change":"2024-09-05T07:49:14.951525+0000","last_active":"2024-09-05T07:49:15.947086+0000","last_peered":"2024-09-05T07:49:15.947086+0000","last_clean":"2024-09-05T07:49:15.947086+0000","last_became_active":"2024-09-05T07:49:14.951007+0000","last_became_peered":"2024-09-05T07:49:14.951007+0000","last_unstale":"2024-09-05T07:49:15.947086+0000","last_undegraded":"2024-09-05T07:49:15.947086+0000","last_fullsized":"2024-09-05T07:49:15.947086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:18:17.895969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947606+0000","last_change":"2024-09-05T07:49:14.968131+0000","last_active":"2024-09-05T07:49:15.947606+0000","last_peered":"2024-09-05T07:49:15.947606+0000","last_clean":"2024-09-05T07:49:15.947606+0000","last_became_active":"2024-09-05T07:49:14.967843+0000","last_became_peered":"2024-09-05T07:49:14.967843+0000","last_unstale":"2024-09-05T07:49:15.947606+0000","last_undegraded":"2024-09-05T07:49:15.947606+0000","last_fullsized":"2024-09-05T07:49:15.947606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:10.271731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963754+0000","last_change":"2024-09-05T07:49:14.944475+0000","last_active":"2024-09-05T07:49:15.963754+0000","last_peered":"2024-09-05T07:49:15.963754+0000","last_clean":"2024-09-05T07:49:15.963754+0000","last_became_active":"2024-09-05T07:49:14.944114+0000","last_became_peered":"2024-09-05T07:49:14.944114+0000","last_unstale":"2024-09-05T07:49:15.963754+0000","last_undegraded":"2024-09-05T07:49:15.963754+0000","last_fullsized":"2024-09-05T07:49:15.963754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:51.097613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.962619+0000","last_change":"2024-09-05T07:49:14.955374+0000","last_active":"2024-09-05T07:49:15.962619+0000","last_peered":"2024-09-05T07:49:15.962619+0000","last_clean":"2024-09-05T07:49:15.962619+0000","last_became_active":"2024-09-05T07:49:14.955076+0000","last_became_peered":"2024-09-05T07:49:14.955076+0000","last_unstale":"2024-09-05T07:49:15.962619+0000","last_undegraded":"2024-09-05T07:49:15.962619+0000","last_fullsized":"2024-09-05T07:49:15.962619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:48.784069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947611+0000","last_change":"2024-09-05T07:49:14.957865+0000","last_active":"2024-09-05T07:49:15.947611+0000","last_peered":"2024-09-05T07:49:15.947611+0000","last_clean":"2024-09-05T07:49:15.947611+0000","last_became_active":"2024-09-05T07:49:14.957485+0000","last_became_peered":"2024-09-05T07:49:14.957485+0000","last_unstale":"2024-09-05T07:49:15.947611+0000","last_undegraded":"2024-09-05T07:49:15.947611+0000","last_fullsized":"2024-09-05T07:49:15.947611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:18.126600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959829+0000","last_change":"2024-09-05T07:49:14.957899+0000","last_active":"2024-09-05T07:49:15.959829+0000","last_peered":"2024-09-05T07:49:15.959829+0000","last_clean":"2024-09-05T07:49:15.959829+0000","last_became_active":"2024-09-05T07:49:14.957564+0000","last_became_peered":"2024-09-05T07:49:14.957564+0000","last_unstale":"2024-09-05T07:49:15.959829+0000","last_undegraded":"2024-09-05T07:49:15.959829+0000","last_fullsized":"2024-09-05T07:49:15.959829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:31.162232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959116+0000","last_change":"2024-09-05T07:49:14.958238+0000","last_active":"2024-09-05T07:49:15.959116+0000","last_peered":"2024-09-05T07:49:15.959116+0000","last_clean":"2024-09-05T07:49:15.959116+0000","last_became_active":"2024-09-05T07:49:14.957883+0000","last_became_peered":"2024-09-05T07:49:14.957883+0000","last_unstale":"2024-09-05T07:49:15.959116+0000","last_undegraded":"2024-09-05T07:49:15.959116+0000","last_fullsized":"2024-09-05T07:49:15.959116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:31:42.388350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960461+0000","last_change":"2024-09-05T07:49:14.965003+0000","last_active":"2024-09-05T07:49:15.960461+0000","last_peered":"2024-09-05T07:49:15.960461+0000","last_clean":"2024-09-05T07:49:15.960461+0000","last_became_active":"2024-09-05T07:49:14.964709+0000","last_became_peered":"2024-09-05T07:49:14.964709+0000","last_unstale":"2024-09-05T07:49:15.960461+0000","last_undegraded":"2024-09-05T07:49:15.960461+0000","last_fullsized":"2024-09-05T07:49:15.960461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:06.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947651+0000","last_change":"2024-09-05T07:49:14.946355+0000","last_active":"2024-09-05T07:49:15.947651+0000","last_peered":"2024-09-05T07:49:15.947651+0000","last_clean":"2024-09-05T07:49:15.947651+0000","last_became_active":"2024-09-05T07:49:14.946060+0000","last_became_peered":"2024-09-05T07:49:14.946060+0000","last_unstale":"2024-09-05T07:49:15.947651+0000","last_undegraded":"2024-09-05T07:49:15.947651+0000","last_fullsized":"2024-09-05T07:49:15.947651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:31.578598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964174+0000","last_change":"2024-09-05T07:49:14.947815+0000","last_active":"2024-09-05T07:49:15.964174+0000","last_peered":"2024-09-05T07:49:15.964174+0000","last_clean":"2024-09-05T07:49:15.964174+0000","last_became_active":"2024-09-05T07:49:14.947470+0000","last_became_peered":"2024-09-05T07:49:14.947470+0000","last_unstale":"2024-09-05T07:49:15.964174+0000","last_undegraded":"2024-09-05T07:49:15.964174+0000","last_fullsized":"2024-09-05T07:49:15.964174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:31.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960814+0000","last_change":"2024-09-05T07:49:14.951838+0000","last_active":"2024-09-05T07:49:15.960814+0000","last_peered":"2024-09-05T07:49:15.960814+0000","last_clean":"2024-09-05T07:49:15.960814+0000","last_became_active":"2024-09-05T07:49:14.951505+0000","last_became_peered":"2024-09-05T07:49:14.951505+0000","last_unstale":"2024-09-05T07:49:15.960814+0000","last_undegraded":"2024-09-05T07:49:15.960814+0000","last_fullsized":"2024-09-05T07:49:15.960814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:51:03.739607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963924+0000","last_change":"2024-09-05T07:49:14.961668+0000","last_active":"2024-09-05T07:49:15.963924+0000","last_peered":"2024-09-05T07:49:15.963924+0000","last_clean":"2024-09-05T07:49:15.963924+0000","last_became_active":"2024-09-05T07:49:14.961161+0000","last_became_peered":"2024-09-05T07:49:14.961161+0000","last_unstale":"2024-09-05T07:49:15.963924+0000","last_undegraded":"2024-09-05T07:49:15.963924+0000","last_fullsized":"2024-09-05T07:49:15.963924+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:13:33.263713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947168+0000","last_change":"2024-09-05T07:49:14.955690+0000","last_active":"2024-09-05T07:49:15.947168+0000","last_peered":"2024-09-05T07:49:15.947168+0000","last_clean":"2024-09-05T07:49:15.947168+0000","last_became_active":"2024-09-05T07:49:14.955361+0000","last_became_peered":"2024-09-05T07:49:14.955361+0000","last_unstale":"2024-09-05T07:49:15.947168+0000","last_undegraded":"2024-09-05T07:49:15.947168+0000","last_fullsized":"2024-09-05T07:49:15.947168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:24.301568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947422+0000","last_change":"2024-09-05T07:49:14.949907+0000","last_active":"2024-09-05T07:49:15.947422+0000","last_peered":"2024-09-05T07:49:15.947422+0000","last_clean":"2024-09-05T07:49:15.947422+0000","last_became_active":"2024-09-05T07:49:14.949583+0000","last_became_peered":"2024-09-05T07:49:14.949583+0000","last_unstale":"2024-09-05T07:49:15.947422+0000","last_undegraded":"2024-09-05T07:49:15.947422+0000","last_fullsized":"2024-09-05T07:49:15.947422+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:42:38.342496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963375+0000","last_change":"2024-09-05T07:49:14.943501+0000","last_active":"2024-09-05T07:49:15.963375+0000","last_peered":"2024-09-05T07:49:15.963375+0000","last_clean":"2024-09-05T07:49:15.963375+0000","last_became_active":"2024-09-05T07:49:14.943184+0000","last_became_peered":"2024-09-05T07:49:14.943184+0000","last_unstale":"2024-09-05T07:49:15.963375+0000","last_undegraded":"2024-09-05T07:49:15.963375+0000","last_fullsized":"2024-09-05T07:49:15.963375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:11:30.840749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959120+0000","last_change":"2024-09-05T07:49:14.947161+0000","last_active":"2024-09-05T07:49:15.959120+0000","last_peered":"2024-09-05T07:49:15.959120+0000","last_clean":"2024-09-05T07:49:15.959120+0000","last_became_active":"2024-09-05T07:49:14.946830+0000","last_became_peered":"2024-09-05T07:49:14.946830+0000","last_unstale":"2024-09-05T07:49:15.959120+0000","last_undegraded":"2024-09-05T07:49:15.959120+0000","last_fullsized":"2024-09-05T07:49:15.959120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:24:03.193771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:43.386864+0000","last_change":"2024-09-05T07:49:12.623481+0000","last_active":"2024-09-05T07:49:43.386864+0000","last_peered":"2024-09-05T07:49:43.386864+0000","last_clean":"2024-09-05T07:49:43.386864+0000","last_became_active":"2024-09-05T07:49:12.623138+0000","last_became_peered":"2024-09-05T07:49:12.623138+0000","last_unstale":"2024-09-05T07:49:43.386864+0000","last_undegraded":"2024-09-05T07:49:43.386864+0000","last_fullsized":"2024-09-05T07:49:43.386864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:05:20.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.962534+0000","last_change":"2024-09-05T07:49:14.958574+0000","last_active":"2024-09-05T07:49:15.962534+0000","last_peered":"2024-09-05T07:49:15.962534+0000","last_clean":"2024-09-05T07:49:15.962534+0000","last_became_active":"2024-09-05T07:49:14.958240+0000","last_became_peered":"2024-09-05T07:49:14.958240+0000","last_unstale":"2024-09-05T07:49:15.962534+0000","last_undegraded":"2024-09-05T07:49:15.962534+0000","last_fullsized":"2024-09-05T07:49:15.962534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:50.616710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.346005+0000","last_change":"2024-09-05T07:49:12.622424+0000","last_active":"2024-09-05T07:49:26.346005+0000","last_peered":"2024-09-05T07:49:26.346005+0000","last_clean":"2024-09-05T07:49:26.346005+0000","last_became_active":"2024-09-05T07:49:12.622081+0000","last_became_peered":"2024-09-05T07:49:12.622081+0000","last_unstale":"2024-09-05T07:49:26.346005+0000","last_undegraded":"2024-09-05T07:49:26.346005+0000","last_fullsized":"2024-09-05T07:49:26.346005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:12.531564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:25.340111+0000","last_change":"2024-09-05T07:49:12.619623+0000","last_active":"2024-09-05T07:49:25.340111+0000","last_peered":"2024-09-05T07:49:25.340111+0000","last_clean":"2024-09-05T07:49:25.340111+0000","last_became_active":"2024-09-05T07:49:12.618756+0000","last_became_peered":"2024-09-05T07:49:12.618756+0000","last_unstale":"2024-09-05T07:49:25.340111+0000","last_undegraded":"2024-09-05T07:49:25.340111+0000","last_fullsized":"2024-09-05T07:49:25.340111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:57:55.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959570+0000","last_change":"2024-09-05T07:49:14.966157+0000","last_active":"2024-09-05T07:49:15.959570+0000","last_peered":"2024-09-05T07:49:15.959570+0000","last_clean":"2024-09-05T07:49:15.959570+0000","last_became_active":"2024-09-05T07:49:14.963557+0000","last_became_peered":"2024-09-05T07:49:14.963557+0000","last_unstale":"2024-09-05T07:49:15.959570+0000","last_undegraded":"2024-09-05T07:49:15.959570+0000","last_fullsized":"2024-09-05T07:49:15.959570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:17.900388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.354654+0000","last_change":"2024-09-05T07:49:12.620531+0000","last_active":"2024-09-05T07:49:27.354654+0000","last_peered":"2024-09-05T07:49:27.354654+0000","last_clean":"2024-09-05T07:49:27.354654+0000","last_became_active":"2024-09-05T07:49:12.620227+0000","last_became_peered":"2024-09-05T07:49:12.620227+0000","last_unstale":"2024-09-05T07:49:27.354654+0000","last_undegraded":"2024-09-05T07:49:27.354654+0000","last_fullsized":"2024-09-05T07:49:27.354654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:43.694290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946955+0000","last_change":"2024-09-05T07:49:14.964372+0000","last_active":"2024-09-05T07:49:15.946955+0000","last_peered":"2024-09-05T07:49:15.946955+0000","last_clean":"2024-09-05T07:49:15.946955+0000","last_became_active":"2024-09-05T07:49:14.964017+0000","last_became_peered":"2024-09-05T07:49:14.964017+0000","last_unstale":"2024-09-05T07:49:15.946955+0000","last_undegraded":"2024-09-05T07:49:15.946955+0000","last_fullsized":"2024-09-05T07:49:15.946955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:21:05.059035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.383628+0000","last_change":"2024-09-05T07:49:12.617764+0000","last_active":"2024-09-05T07:49:41.383628+0000","last_peered":"2024-09-05T07:49:41.383628+0000","last_clean":"2024-09-05T07:49:41.383628+0000","last_became_active":"2024-09-05T07:49:12.617362+0000","last_became_peered":"2024-09-05T07:49:12.617362+0000","last_unstale":"2024-09-05T07:49:41.383628+0000","last_undegraded":"2024-09-05T07:49:41.383628+0000","last_fullsized":"2024-09-05T07:49:41.383628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:27.291110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.948022+0000","last_change":"2024-09-05T07:49:14.946462+0000","last_active":"2024-09-05T07:49:15.948022+0000","last_peered":"2024-09-05T07:49:15.948022+0000","last_clean":"2024-09-05T07:49:15.948022+0000","last_became_active":"2024-09-05T07:49:14.946148+0000","last_became_peered":"2024-09-05T07:49:14.946148+0000","last_unstale":"2024-09-05T07:49:15.948022+0000","last_undegraded":"2024-09-05T07:49:15.948022+0000","last_fullsized":"2024-09-05T07:49:15.948022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:58.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355158+0000","last_change":"2024-09-05T07:49:12.624126+0000","last_active":"2024-09-05T07:49:27.355158+0000","last_peered":"2024-09-05T07:49:27.355158+0000","last_clean":"2024-09-05T07:49:27.355158+0000","last_became_active":"2024-09-05T07:49:12.623552+0000","last_became_peered":"2024-09-05T07:49:12.623552+0000","last_unstale":"2024-09-05T07:49:27.355158+0000","last_undegraded":"2024-09-05T07:49:27.355158+0000","last_fullsized":"2024-09-05T07:49:27.355158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:32.068841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964341+0000","last_change":"2024-09-05T07:49:14.953564+0000","last_active":"2024-09-05T07:49:15.964341+0000","last_peered":"2024-09-05T07:49:15.964341+0000","last_clean":"2024-09-05T07:49:15.964341+0000","last_became_active":"2024-09-05T07:49:14.953257+0000","last_became_peered":"2024-09-05T07:49:14.953257+0000","last_unstale":"2024-09-05T07:49:15.964341+0000","last_undegraded":"2024-09-05T07:49:15.964341+0000","last_fullsized":"2024-09-05T07:49:15.964341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:46.140705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.344037+0000","last_change":"2024-09-05T07:49:12.923484+0000","last_active":"2024-09-05T07:49:26.344037+0000","last_peered":"2024-09-05T07:49:26.344037+0000","last_clean":"2024-09-05T07:49:26.344037+0000","last_became_active":"2024-09-05T07:49:12.923039+0000","last_became_peered":"2024-09-05T07:49:12.923039+0000","last_unstale":"2024-09-05T07:49:26.344037+0000","last_undegraded":"2024-09-05T07:49:26.344037+0000","last_fullsized":"2024-09-05T07:49:26.344037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:25:32.918343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947737+0000","last_change":"2024-09-05T07:49:14.946368+0000","last_active":"2024-09-05T07:49:15.947737+0000","last_peered":"2024-09-05T07:49:15.947737+0000","last_clean":"2024-09-05T07:49:15.947737+0000","last_became_active":"2024-09-05T07:49:14.946023+0000","last_became_peered":"2024-09-05T07:49:14.946023+0000","last_unstale":"2024-09-05T07:49:15.947737+0000","last_undegraded":"2024-09-05T07:49:15.947737+0000","last_fullsized":"2024-09-05T07:49:15.947737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:27.579086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'24","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384957+0000","last_change":"2024-09-05T07:49:12.623923+0000","last_active":"2024-09-05T07:49:41.384957+0000","last_peered":"2024-09-05T07:49:41.384957+0000","last_clean":"2024-09-05T07:49:41.384957+0000","last_became_active":"2024-09-05T07:49:12.623559+0000","last_became_peered":"2024-09-05T07:49:12.623559+0000","last_unstale":"2024-09-05T07:49:41.384957+0000","last_undegraded":"2024-09-05T07:49:41.384957+0000","last_fullsized":"2024-09-05T07:49:41.384957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:10.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960149+0000","last_change":"2024-09-05T07:49:14.953936+0000","last_active":"2024-09-05T07:49:15.960149+0000","last_peered":"2024-09-05T07:49:15.960149+0000","last_clean":"2024-09-05T07:49:15.960149+0000","last_became_active":"2024-09-05T07:49:14.952830+0000","last_became_peered":"2024-09-05T07:49:14.952830+0000","last_unstale":"2024-09-05T07:49:15.960149+0000","last_undegraded":"2024-09-05T07:49:15.960149+0000","last_fullsized":"2024-09-05T07:49:15.960149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:26.907025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.360931+0000","last_change":"2024-09-05T07:49:12.623299+0000","last_active":"2024-09-05T07:49:28.360931+0000","last_peered":"2024-09-05T07:49:28.360931+0000","last_clean":"2024-09-05T07:49:28.360931+0000","last_became_active":"2024-09-05T07:49:12.622942+0000","last_became_peered":"2024-09-05T07:49:12.622942+0000","last_unstale":"2024-09-05T07:49:28.360931+0000","last_undegraded":"2024-09-05T07:49:28.360931+0000","last_fullsized":"2024-09-05T07:49:28.360931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:59:07.846104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.961405+0000","last_change":"2024-09-05T07:49:14.959269+0000","last_active":"2024-09-05T07:49:15.961405+0000","last_peered":"2024-09-05T07:49:15.961405+0000","last_clean":"2024-09-05T07:49:15.961405+0000","last_became_active":"2024-09-05T07:49:14.956838+0000","last_became_peered":"2024-09-05T07:49:14.956838+0000","last_unstale":"2024-09-05T07:49:15.961405+0000","last_undegraded":"2024-09-05T07:49:15.961405+0000","last_fullsized":"2024-09-05T07:49:15.961405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:40.047519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355545+0000","last_change":"2024-09-05T07:49:12.618068+0000","last_active":"2024-09-05T07:49:27.355545+0000","last_peered":"2024-09-05T07:49:27.355545+0000","last_clean":"2024-09-05T07:49:27.355545+0000","last_became_active":"2024-09-05T07:49:12.617125+0000","last_became_peered":"2024-09-05T07:49:12.617125+0000","last_unstale":"2024-09-05T07:49:27.355545+0000","last_undegraded":"2024-09-05T07:49:27.355545+0000","last_fullsized":"2024-09-05T07:49:27.355545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:39:50.999342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946994+0000","last_change":"2024-09-05T07:49:14.956131+0000","last_active":"2024-09-05T07:49:15.946994+0000","last_peered":"2024-09-05T07:49:15.946994+0000","last_clean":"2024-09-05T07:49:15.946994+0000","last_became_active":"2024-09-05T07:49:14.955817+0000","last_became_peered":"2024-09-05T07:49:14.955817+0000","last_unstale":"2024-09-05T07:49:15.946994+0000","last_undegraded":"2024-09-05T07:49:15.946994+0000","last_fullsized":"2024-09-05T07:49:15.946994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:14.800599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:44.388021+0000","last_change":"2024-09-05T07:49:12.620990+0000","last_active":"2024-09-05T07:49:44.388021+0000","last_peered":"2024-09-05T07:49:44.388021+0000","last_clean":"2024-09-05T07:49:44.388021+0000","last_became_active":"2024-09-05T07:49:12.620571+0000","last_became_peered":"2024-09-05T07:49:12.620571+0000","last_unstale":"2024-09-05T07:49:44.388021+0000","last_undegraded":"2024-09-05T07:49:44.388021+0000","last_fullsized":"2024-09-05T07:49:44.388021+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:01.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946784+0000","last_change":"2024-09-05T07:49:14.954588+0000","last_active":"2024-09-05T07:49:15.946784+0000","last_peered":"2024-09-05T07:49:15.946784+0000","last_clean":"2024-09-05T07:49:15.946784+0000","last_became_active":"2024-09-05T07:49:14.954252+0000","last_became_peered":"2024-09-05T07:49:14.954252+0000","last_unstale":"2024-09-05T07:49:15.946784+0000","last_undegraded":"2024-09-05T07:49:15.946784+0000","last_fullsized":"2024-09-05T07:49:15.946784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:31.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355078+0000","last_change":"2024-09-05T07:49:12.922771+0000","last_active":"2024-09-05T07:49:27.355078+0000","last_peered":"2024-09-05T07:49:27.355078+0000","last_clean":"2024-09-05T07:49:27.355078+0000","last_became_active":"2024-09-05T07:49:12.922377+0000","last_became_peered":"2024-09-05T07:49:12.922377+0000","last_unstale":"2024-09-05T07:49:27.355078+0000","last_undegraded":"2024-09-05T07:49:27.355078+0000","last_fullsized":"2024-09-05T07:49:27.355078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:54.376164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963368+0000","last_change":"2024-09-05T07:49:14.954094+0000","last_active":"2024-09-05T07:49:15.963368+0000","last_peered":"2024-09-05T07:49:15.963368+0000","last_clean":"2024-09-05T07:49:15.963368+0000","last_became_active":"2024-09-05T07:49:14.953783+0000","last_became_peered":"2024-09-05T07:49:14.953783+0000","last_unstale":"2024-09-05T07:49:15.963368+0000","last_undegraded":"2024-09-05T07:49:15.963368+0000","last_fullsized":"2024-09-05T07:49:15.963368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:11.209443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.335132+0000","last_change":"2024-09-05T07:49:12.623690+0000","last_active":"2024-09-05T07:49:26.335132+0000","last_peered":"2024-09-05T07:49:26.335132+0000","last_clean":"2024-09-05T07:49:26.335132+0000","last_became_active":"2024-09-05T07:49:12.623315+0000","last_became_peered":"2024-09-05T07:49:12.623315+0000","last_unstale":"2024-09-05T07:49:26.335132+0000","last_undegraded":"2024-09-05T07:49:26.335132+0000","last_fullsized":"2024-09-05T07:49:26.335132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:01.293175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964105+0000","last_change":"2024-09-05T07:49:14.943190+0000","last_active":"2024-09-05T07:49:15.964105+0000","last_peered":"2024-09-05T07:49:15.964105+0000","last_clean":"2024-09-05T07:49:15.964105+0000","last_became_active":"2024-09-05T07:49:14.942863+0000","last_became_peered":"2024-09-05T07:49:14.942863+0000","last_unstale":"2024-09-05T07:49:15.964105+0000","last_undegraded":"2024-09-05T07:49:15.964105+0000","last_fullsized":"2024-09-05T07:49:15.964105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:54.401096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355343+0000","last_change":"2024-09-05T07:49:12.623328+0000","last_active":"2024-09-05T07:49:27.355343+0000","last_peered":"2024-09-05T07:49:27.355343+0000","last_clean":"2024-09-05T07:49:27.355343+0000","last_became_active":"2024-09-05T07:49:12.622993+0000","last_became_peered":"2024-09-05T07:49:12.622993+0000","last_unstale":"2024-09-05T07:49:27.355343+0000","last_undegraded":"2024-09-05T07:49:27.355343+0000","last_fullsized":"2024-09-05T07:49:27.355343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:11:27.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947462+0000","last_change":"2024-09-05T07:49:14.951250+0000","last_active":"2024-09-05T07:49:15.947462+0000","last_peered":"2024-09-05T07:49:15.947462+0000","last_clean":"2024-09-05T07:49:15.947462+0000","last_became_active":"2024-09-05T07:49:14.950834+0000","last_became_peered":"2024-09-05T07:49:14.950834+0000","last_unstale":"2024-09-05T07:49:15.947462+0000","last_undegraded":"2024-09-05T07:49:15.947462+0000","last_fullsized":"2024-09-05T07:49:15.947462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:42.992517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355485+0000","last_change":"2024-09-05T07:49:12.620555+0000","last_active":"2024-09-05T07:49:27.355485+0000","last_peered":"2024-09-05T07:49:27.355485+0000","last_clean":"2024-09-05T07:49:27.355485+0000","last_became_active":"2024-09-05T07:49:12.619847+0000","last_became_peered":"2024-09-05T07:49:12.619847+0000","last_unstale":"2024-09-05T07:49:27.355485+0000","last_undegraded":"2024-09-05T07:49:27.355485+0000","last_fullsized":"2024-09-05T07:49:27.355485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:18:59.833342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:18.036567+0000","last_change":"2024-09-05T07:49:14.952173+0000","last_active":"2024-09-05T07:49:18.036567+0000","last_peered":"2024-09-05T07:49:18.036567+0000","last_clean":"2024-09-05T07:49:18.036567+0000","last_became_active":"2024-09-05T07:49:14.951848+0000","last_became_peered":"2024-09-05T07:49:14.951848+0000","last_unstale":"2024-09-05T07:49:18.036567+0000","last_undegraded":"2024-09-05T07:49:18.036567+0000","last_fullsized":"2024-09-05T07:49:18.036567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384391+0000","last_change":"2024-09-05T07:49:12.923318+0000","last_active":"2024-09-05T07:49:41.384391+0000","last_peered":"2024-09-05T07:49:41.384391+0000","last_clean":"2024-09-05T07:49:41.384391+0000","last_became_active":"2024-09-05T07:49:12.922965+0000","last_became_peered":"2024-09-05T07:49:12.922965+0000","last_unstale":"2024-09-05T07:49:41.384391+0000","last_undegraded":"2024-09-05T07:49:41.384391+0000","last_fullsized":"2024-09-05T07:49:41.384391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:19.576198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947332+0000","last_change":"2024-09-05T07:49:14.950067+0000","last_active":"2024-09-05T07:49:15.947332+0000","last_peered":"2024-09-05T07:49:15.947332+0000","last_clean":"2024-09-05T07:49:15.947332+0000","last_became_active":"2024-09-05T07:49:14.949580+0000","last_became_peered":"2024-09-05T07:49:14.949580+0000","last_unstale":"2024-09-05T07:49:15.947332+0000","last_undegraded":"2024-09-05T07:49:15.947332+0000","last_fullsized":"2024-09-05T07:49:15.947332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:08.754476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946978+0000","last_change":"2024-09-05T07:47:54.520597+0000","last_active":"2024-09-05T07:49:15.946978+0000","last_peered":"2024-09-05T07:49:15.946978+0000","last_clean":"2024-09-05T07:49:15.946978+0000","last_became_active":"2024-09-05T07:47:54.520187+0000","last_became_peered":"2024-09-05T07:47:54.520187+0000","last_unstale":"2024-09-05T07:49:15.946978+0000","last_undegraded":"2024-09-05T07:49:15.946978+0000","last_fullsized":"2024-09-05T07:49:15.946978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_clean_scrub_stamp":"2024-09-05T07:44:23.832394+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:19.382482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.362473+0000","last_change":"2024-09-05T07:49:12.618142+0000","last_active":"2024-09-05T07:49:28.362473+0000","last_peered":"2024-09-05T07:49:28.362473+0000","last_clean":"2024-09-05T07:49:28.362473+0000","last_became_active":"2024-09-05T07:49:12.617799+0000","last_became_peered":"2024-09-05T07:49:12.617799+0000","last_unstale":"2024-09-05T07:49:28.362473+0000","last_undegraded":"2024-09-05T07:49:28.362473+0000","last_fullsized":"2024-09-05T07:49:28.362473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:34:55.843402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960067+0000","last_change":"2024-09-05T07:49:14.962066+0000","last_active":"2024-09-05T07:49:15.960067+0000","last_peered":"2024-09-05T07:49:15.960067+0000","last_clean":"2024-09-05T07:49:15.960067+0000","last_became_active":"2024-09-05T07:49:14.952793+0000","last_became_peered":"2024-09-05T07:49:14.952793+0000","last_unstale":"2024-09-05T07:49:15.960067+0000","last_undegraded":"2024-09-05T07:49:15.960067+0000","last_fullsized":"2024-09-05T07:49:15.960067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:53.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:25.339286+0000","last_change":"2024-09-05T07:49:12.624350+0000","last_active":"2024-09-05T07:49:25.339286+0000","last_peered":"2024-09-05T07:49:25.339286+0000","last_clean":"2024-09-05T07:49:25.339286+0000","last_became_active":"2024-09-05T07:49:12.623907+0000","last_became_peered":"2024-09-05T07:49:12.623907+0000","last_unstale":"2024-09-05T07:49:25.339286+0000","last_undegraded":"2024-09-05T07:49:25.339286+0000","last_fullsized":"2024-09-05T07:49:25.339286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.663789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959752+0000","last_change":"2024-09-05T07:49:14.953372+0000","last_active":"2024-09-05T07:49:15.959752+0000","last_peered":"2024-09-05T07:49:15.959752+0000","last_clean":"2024-09-05T07:49:15.959752+0000","last_became_active":"2024-09-05T07:49:14.952986+0000","last_became_peered":"2024-09-05T07:49:14.952986+0000","last_unstale":"2024-09-05T07:49:15.959752+0000","last_undegraded":"2024-09-05T07:49:15.959752+0000","last_fullsized":"2024-09-05T07:49:15.959752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:01:55.338289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.383369+0000","last_change":"2024-09-05T07:49:12.923463+0000","last_active":"2024-09-05T07:49:41.383369+0000","last_peered":"2024-09-05T07:49:41.383369+0000","last_clean":"2024-09-05T07:49:41.383369+0000","last_became_active":"2024-09-05T07:49:12.923105+0000","last_became_peered":"2024-09-05T07:49:12.923105+0000","last_unstale":"2024-09-05T07:49:41.383369+0000","last_undegraded":"2024-09-05T07:49:41.383369+0000","last_fullsized":"2024-09-05T07:49:41.383369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:25:21.795954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959179+0000","last_change":"2024-09-05T07:49:14.951796+0000","last_active":"2024-09-05T07:49:15.959179+0000","last_peered":"2024-09-05T07:49:15.959179+0000","last_clean":"2024-09-05T07:49:15.959179+0000","last_became_active":"2024-09-05T07:49:14.951450+0000","last_became_peered":"2024-09-05T07:49:14.951450+0000","last_unstale":"2024-09-05T07:49:15.959179+0000","last_undegraded":"2024-09-05T07:49:15.959179+0000","last_fullsized":"2024-09-05T07:49:15.959179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:52.755044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:41.384036+0000","last_change":"2024-09-05T07:49:12.618510+0000","last_active":"2024-09-05T07:49:41.384036+0000","last_peered":"2024-09-05T07:49:41.384036+0000","last_clean":"2024-09-05T07:49:41.384036+0000","last_became_active":"2024-09-05T07:49:12.618160+0000","last_became_peered":"2024-09-05T07:49:12.618160+0000","last_unstale":"2024-09-05T07:49:41.384036+0000","last_undegraded":"2024-09-05T07:49:41.384036+0000","last_fullsized":"2024-09-05T07:49:41.384036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:52:12.432287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959910+0000","last_change":"2024-09-05T07:49:14.953989+0000","last_active":"2024-09-05T07:49:15.959910+0000","last_peered":"2024-09-05T07:49:15.959910+0000","last_clean":"2024-09-05T07:49:15.959910+0000","last_became_active":"2024-09-05T07:49:14.953651+0000","last_became_peered":"2024-09-05T07:49:14.953651+0000","last_unstale":"2024-09-05T07:49:15.959910+0000","last_undegraded":"2024-09-05T07:49:15.959910+0000","last_fullsized":"2024-09-05T07:49:15.959910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:36.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.946960+0000","last_change":"2024-09-05T07:49:12.923661+0000","last_active":"2024-09-05T07:49:15.946960+0000","last_peered":"2024-09-05T07:49:15.946960+0000","last_clean":"2024-09-05T07:49:15.946960+0000","last_became_active":"2024-09-05T07:49:12.923273+0000","last_became_peered":"2024-09-05T07:49:12.923273+0000","last_unstale":"2024-09-05T07:49:15.946960+0000","last_undegraded":"2024-09-05T07:49:15.946960+0000","last_fullsized":"2024-09-05T07:49:15.946960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:08.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:17.350512+0000","last_change":"2024-09-05T07:49:14.964797+0000","last_active":"2024-09-05T07:49:17.350512+0000","last_peered":"2024-09-05T07:49:17.350512+0000","last_clean":"2024-09-05T07:49:17.350512+0000","last_became_active":"2024-09-05T07:49:14.964411+0000","last_became_peered":"2024-09-05T07:49:14.964411+0000","last_unstale":"2024-09-05T07:49:17.350512+0000","last_undegraded":"2024-09-05T07:49:17.350512+0000","last_fullsized":"2024-09-05T07:49:17.350512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:55:37.150270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355321+0000","last_change":"2024-09-05T07:49:12.924896+0000","last_active":"2024-09-05T07:49:27.355321+0000","last_peered":"2024-09-05T07:49:27.355321+0000","last_clean":"2024-09-05T07:49:27.355321+0000","last_became_active":"2024-09-05T07:49:12.924556+0000","last_became_peered":"2024-09-05T07:49:12.924556+0000","last_unstale":"2024-09-05T07:49:27.355321+0000","last_undegraded":"2024-09-05T07:49:27.355321+0000","last_fullsized":"2024-09-05T07:49:27.355321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:02:37.433963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960955+0000","last_change":"2024-09-05T07:49:14.953635+0000","last_active":"2024-09-05T07:49:15.960955+0000","last_peered":"2024-09-05T07:49:15.960955+0000","last_clean":"2024-09-05T07:49:15.960955+0000","last_became_active":"2024-09-05T07:49:14.950967+0000","last_became_peered":"2024-09-05T07:49:14.950967+0000","last_unstale":"2024-09-05T07:49:15.960955+0000","last_undegraded":"2024-09-05T07:49:15.960955+0000","last_fullsized":"2024-09-05T07:49:15.960955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:20:47.539927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'15","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:43.964543+0000","last_change":"2024-09-05T07:49:12.621601+0000","last_active":"2024-09-05T07:49:43.964543+0000","last_peered":"2024-09-05T07:49:43.964543+0000","last_clean":"2024-09-05T07:49:43.964543+0000","last_became_active":"2024-09-05T07:49:12.621285+0000","last_became_peered":"2024-09-05T07:49:12.621285+0000","last_unstale":"2024-09-05T07:49:43.964543+0000","last_undegraded":"2024-09-05T07:49:43.964543+0000","last_fullsized":"2024-09-05T07:49:43.964543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:54:28.216480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960594+0000","last_change":"2024-09-05T07:49:14.963083+0000","last_active":"2024-09-05T07:49:15.960594+0000","last_peered":"2024-09-05T07:49:15.960594+0000","last_clean":"2024-09-05T07:49:15.960594+0000","last_became_active":"2024-09-05T07:49:14.962763+0000","last_became_peered":"2024-09-05T07:49:14.962763+0000","last_unstale":"2024-09-05T07:49:15.960594+0000","last_undegraded":"2024-09-05T07:49:15.960594+0000","last_fullsized":"2024-09-05T07:49:15.960594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:41.475517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.356138+0000","last_change":"2024-09-05T07:49:12.630250+0000","last_active":"2024-09-05T07:49:27.356138+0000","last_peered":"2024-09-05T07:49:27.356138+0000","last_clean":"2024-09-05T07:49:27.356138+0000","last_became_active":"2024-09-05T07:49:12.629953+0000","last_became_peered":"2024-09-05T07:49:12.629953+0000","last_unstale":"2024-09-05T07:49:27.356138+0000","last_undegraded":"2024-09-05T07:49:27.356138+0000","last_fullsized":"2024-09-05T07:49:27.356138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:30:26.217587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964337+0000","last_change":"2024-09-05T07:49:14.965623+0000","last_active":"2024-09-05T07:49:15.964337+0000","last_peered":"2024-09-05T07:49:15.964337+0000","last_clean":"2024-09-05T07:49:15.964337+0000","last_became_active":"2024-09-05T07:49:14.964544+0000","last_became_peered":"2024-09-05T07:49:14.964544+0000","last_unstale":"2024-09-05T07:49:15.964337+0000","last_undegraded":"2024-09-05T07:49:15.964337+0000","last_fullsized":"2024-09-05T07:49:15.964337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:03:51.723187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:24.325855+0000","last_change":"2024-09-05T07:49:12.922943+0000","last_active":"2024-09-05T07:49:24.325855+0000","last_peered":"2024-09-05T07:49:24.325855+0000","last_clean":"2024-09-05T07:49:24.325855+0000","last_became_active":"2024-09-05T07:49:12.922553+0000","last_became_peered":"2024-09-05T07:49:12.922553+0000","last_unstale":"2024-09-05T07:49:24.325855+0000","last_undegraded":"2024-09-05T07:49:24.325855+0000","last_fullsized":"2024-09-05T07:49:24.325855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:08:39.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959030+0000","last_change":"2024-09-05T07:49:14.950904+0000","last_active":"2024-09-05T07:49:15.959030+0000","last_peered":"2024-09-05T07:49:15.959030+0000","last_clean":"2024-09-05T07:49:15.959030+0000","last_became_active":"2024-09-05T07:49:14.950553+0000","last_became_peered":"2024-09-05T07:49:14.950553+0000","last_unstale":"2024-09-05T07:49:15.959030+0000","last_undegraded":"2024-09-05T07:49:15.959030+0000","last_fullsized":"2024-09-05T07:49:15.959030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:31:35.255414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.353918+0000","last_change":"2024-09-05T07:49:12.617926+0000","last_active":"2024-09-05T07:49:27.353918+0000","last_peered":"2024-09-05T07:49:27.353918+0000","last_clean":"2024-09-05T07:49:27.353918+0000","last_became_active":"2024-09-05T07:49:12.617168+0000","last_became_peered":"2024-09-05T07:49:12.617168+0000","last_unstale":"2024-09-05T07:49:27.353918+0000","last_undegraded":"2024-09-05T07:49:27.353918+0000","last_fullsized":"2024-09-05T07:49:27.353918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:24.934339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.963604+0000","last_change":"2024-09-05T07:49:14.951658+0000","last_active":"2024-09-05T07:49:15.963604+0000","last_peered":"2024-09-05T07:49:15.963604+0000","last_clean":"2024-09-05T07:49:15.963604+0000","last_became_active":"2024-09-05T07:49:14.951328+0000","last_became_peered":"2024-09-05T07:49:14.951328+0000","last_unstale":"2024-09-05T07:49:15.963604+0000","last_undegraded":"2024-09-05T07:49:15.963604+0000","last_fullsized":"2024-09-05T07:49:15.963604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:30:06.429805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:26.345714+0000","last_change":"2024-09-05T07:49:12.626227+0000","last_active":"2024-09-05T07:49:26.345714+0000","last_peered":"2024-09-05T07:49:26.345714+0000","last_clean":"2024-09-05T07:49:26.345714+0000","last_became_active":"2024-09-05T07:49:12.625440+0000","last_became_peered":"2024-09-05T07:49:12.625440+0000","last_unstale":"2024-09-05T07:49:26.345714+0000","last_undegraded":"2024-09-05T07:49:26.345714+0000","last_fullsized":"2024-09-05T07:49:26.345714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:26:37.874247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.960273+0000","last_change":"2024-09-05T07:49:14.963017+0000","last_active":"2024-09-05T07:49:15.960273+0000","last_peered":"2024-09-05T07:49:15.960273+0000","last_clean":"2024-09-05T07:49:15.960273+0000","last_became_active":"2024-09-05T07:49:14.962655+0000","last_became_peered":"2024-09-05T07:49:14.962655+0000","last_unstale":"2024-09-05T07:49:15.960273+0000","last_undegraded":"2024-09-05T07:49:15.960273+0000","last_fullsized":"2024-09-05T07:49:15.960273+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:59.068930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:24.326985+0000","last_change":"2024-09-05T07:49:12.624658+0000","last_active":"2024-09-05T07:49:24.326985+0000","last_peered":"2024-09-05T07:49:24.326985+0000","last_clean":"2024-09-05T07:49:24.326985+0000","last_became_active":"2024-09-05T07:49:12.624301+0000","last_became_peered":"2024-09-05T07:49:12.624301+0000","last_unstale":"2024-09-05T07:49:24.326985+0000","last_undegraded":"2024-09-05T07:49:24.326985+0000","last_fullsized":"2024-09-05T07:49:24.326985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:15:14.941108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947406+0000","last_change":"2024-09-05T07:49:14.953562+0000","last_active":"2024-09-05T07:49:15.947406+0000","last_peered":"2024-09-05T07:49:15.947406+0000","last_clean":"2024-09-05T07:49:15.947406+0000","last_became_active":"2024-09-05T07:49:14.953242+0000","last_became_peered":"2024-09-05T07:49:14.953242+0000","last_unstale":"2024-09-05T07:49:15.947406+0000","last_undegraded":"2024-09-05T07:49:15.947406+0000","last_fullsized":"2024-09-05T07:49:15.947406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:02.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959614+0000","last_change":"2024-09-05T07:49:14.955497+0000","last_active":"2024-09-05T07:49:15.959614+0000","last_peered":"2024-09-05T07:49:15.959614+0000","last_clean":"2024-09-05T07:49:15.959614+0000","last_became_active":"2024-09-05T07:49:14.955138+0000","last_became_peered":"2024-09-05T07:49:14.955138+0000","last_unstale":"2024-09-05T07:49:15.959614+0000","last_undegraded":"2024-09-05T07:49:15.959614+0000","last_fullsized":"2024-09-05T07:49:15.959614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:17:17.869062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:27.355088+0000","last_change":"2024-09-05T07:49:12.624583+0000","last_active":"2024-09-05T07:49:27.355088+0000","last_peered":"2024-09-05T07:49:27.355088+0000","last_clean":"2024-09-05T07:49:27.355088+0000","last_became_active":"2024-09-05T07:49:12.624184+0000","last_became_peered":"2024-09-05T07:49:12.624184+0000","last_unstale":"2024-09-05T07:49:27.355088+0000","last_undegraded":"2024-09-05T07:49:27.355088+0000","last_fullsized":"2024-09-05T07:49:27.355088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:46:33.137089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.947697+0000","last_change":"2024-09-05T07:49:14.955735+0000","last_active":"2024-09-05T07:49:15.947697+0000","last_peered":"2024-09-05T07:49:15.947697+0000","last_clean":"2024-09-05T07:49:15.947697+0000","last_became_active":"2024-09-05T07:49:14.955388+0000","last_became_peered":"2024-09-05T07:49:14.955388+0000","last_unstale":"2024-09-05T07:49:15.947697+0000","last_undegraded":"2024-09-05T07:49:15.947697+0000","last_fullsized":"2024-09-05T07:49:15.947697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:07:15.436676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:28.360757+0000","last_change":"2024-09-05T07:49:12.627580+0000","last_active":"2024-09-05T07:49:28.360757+0000","last_peered":"2024-09-05T07:49:28.360757+0000","last_clean":"2024-09-05T07:49:28.360757+0000","last_became_active":"2024-09-05T07:49:12.627127+0000","last_became_peered":"2024-09-05T07:49:12.627127+0000","last_unstale":"2024-09-05T07:49:28.360757+0000","last_undegraded":"2024-09-05T07:49:28.360757+0000","last_fullsized":"2024-09-05T07:49:28.360757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:06.903093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.964322+0000","last_change":"2024-09-05T07:49:14.952234+0000","last_active":"2024-09-05T07:49:15.964322+0000","last_peered":"2024-09-05T07:49:15.964322+0000","last_clean":"2024-09-05T07:49:15.964322+0000","last_became_active":"2024-09-05T07:49:14.948805+0000","last_became_peered":"2024-09-05T07:49:14.948805+0000","last_unstale":"2024-09-05T07:49:15.964322+0000","last_undegraded":"2024-09-05T07:49:15.964322+0000","last_fullsized":"2024-09-05T07:49:15.964322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:49.101303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.967017+0000","last_change":"2024-09-05T07:49:12.922749+0000","last_active":"2024-09-05T07:49:15.967017+0000","last_peered":"2024-09-05T07:49:15.967017+0000","last_clean":"2024-09-05T07:49:15.967017+0000","last_became_active":"2024-09-05T07:49:12.922415+0000","last_became_peered":"2024-09-05T07:49:12.922415+0000","last_unstale":"2024-09-05T07:49:15.967017+0000","last_undegraded":"2024-09-05T07:49:15.967017+0000","last_fullsized":"2024-09-05T07:49:15.967017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:19:58.163647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:15.959992+0000","last_change":"2024-09-05T07:49:14.957792+0000","last_active":"2024-09-05T07:49:15.959992+0000","last_peered":"2024-09-05T07:49:15.959992+0000","last_clean":"2024-09-05T07:49:15.959992+0000","last_became_active":"2024-09-05T07:49:14.957312+0000","last_became_peered":"2024-09-05T07:49:14.957312+0000","last_unstale":"2024-09-05T07:49:15.959992+0000","last_undegraded":"2024-09-05T07:49:15.959992+0000","last_fullsized":"2024-09-05T07:49:15.959992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:55:17.422990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T07:49:45.388896+0000","last_change":"2024-09-05T07:49:12.621834+0000","last_active":"2024-09-05T07:49:45.388896+0000","last_peered":"2024-09-05T07:49:45.388896+0000","last_clean":"2024-09-05T07:49:45.388896+0000","last_became_active":"2024-09-05T07:49:12.621446+0000","last_became_peered":"2024-09-05T07:49:12.621446+0000","last_unstale":"2024-09-05T07:49:45.388896+0000","last_undegraded":"2024-09-05T07:49:45.388896+0000","last_fullsized":"2024-09-05T07:49:45.388896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:32.790982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":194,"num_read_kb":157,"num_write":238,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":170852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282052,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481811,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":430631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1068855,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874269,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":430561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":430939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364840,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1024245,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528366,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":430671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1023137,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":430532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":430103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":478606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":486029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":431617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:49:48.237 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T07:49:48.240 INFO:tasks.cephadm:Setting up client nodes... 2024-09-05T07:49:48.241 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-05T07:49:48.560 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:48 smithi144 ceph-mon[29535]: pgmap v304: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-05T07:49:48.561 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:48 smithi144 ceph-mon[29535]: from='client.24670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:48.624 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:48 smithi154 ceph-mon[34710]: pgmap v304: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-05T07:49:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:48 smithi154 ceph-mon[34710]: from='client.24670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:48 smithi175 ceph-mon[34585]: pgmap v304: 97 pgs: 97 active+clean; 630 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-05T07:49:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:48 smithi175 ceph-mon[34585]: from='client.24670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:49:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 -- 172.21.15.144:0/3101224128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40104f60 msgr2=0x7f6c401053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 --2- 172.21.15.144:0/3101224128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40104f60 0x7f6c401053e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009900 tx=0x7f6c2c02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 -- 172.21.15.144:0/3101224128 shutdown_connections 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 --2- 172.21.15.144:0/3101224128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40105920 0x7f6c4010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 --2- 172.21.15.144:0/3101224128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40104f60 0x7f6c401053e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 --2- 172.21.15.144:0/3101224128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40103e00 0x7f6c40104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 -- 172.21.15.144:0/3101224128 >> 172.21.15.144:0/3101224128 conn(0x7f6c400ff5b0 msgr2=0x7f6c401019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 -- 172.21.15.144:0/3101224128 shutdown_connections 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.206+0000 7f6c48200640 1 -- 172.21.15.144:0/3101224128 wait complete. 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.207+0000 7f6c48200640 1 Processor -- start 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 -- start start 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40104f60 0x7f6c4019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 0x7f6c401a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010fa90 con 0x7f6c40105920 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010f910 con 0x7f6c40104f60 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c48200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010fc10 con 0x7f6c40103e00 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c46200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 0x7f6c401a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:50256/0 (socket says 172.21.15.144:50256) 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c45800640 1 -- 172.21.15.144:0/511616012 learned_addr learned my addr 172.21.15.144:0/511616012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c46200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 0x7f6c401a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57624/0 (socket says 172.21.15.144:57624) 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.208+0000 7f6c44e00640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40104f60 0x7f6c4019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 -- 172.21.15.144:0/511616012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40104f60 msgr2=0x7f6c4019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40104f60 0x7f6c4019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 -- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 msgr2=0x7f6c401a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 0x7f6c401a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 -- 172.21.15.144:0/511616012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c401a1d40 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c45800640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400ebc0 tx=0x7f6c3400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34010630 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c401a1fd0 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c34010cb0 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34018bd0 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.209+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401a2480 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.210+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4010b1f0 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.212+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6c340107d0 con 0x7f6c40103e00 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.213+0000 7f6c3e000640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 0x7f6c280a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:49.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.214+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f6c340cf9d0 con 0x7f6c40103e00 2024-09-05T07:49:49.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.214+0000 7f6c44e00640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 0x7f6c280a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:49.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.214+0000 7f6c44e00640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 0x7f6c280a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005ab0 tx=0x7f6c2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:49.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.215+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c3409c230 con 0x7f6c40103e00 2024-09-05T07:49:49.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.461+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6c4002d7c0 con 0x7f6c40103e00 2024-09-05T07:49:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.468+0000 7f6c3e000640 1 -- 172.21.15.144:0/511616012 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f6c340a0530 con 0x7f6c40103e00 2024-09-05T07:49:49.472 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-05T07:49:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCdYtlmXoGhGxAA1vAtetZ3p2LCLplSAFihqw== 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 msgr2=0x7f6c280a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 0x7f6c280a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005ab0 tx=0x7f6c2c000bc0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 msgr2=0x7f6c4019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400ebc0 tx=0x7f6c3400c6a0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 shutdown_connections 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f6c280a2c40 0x7f6c280a5100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c40104f60 0x7f6c4019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c40105920 0x7f6c401a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 --2- 172.21.15.144:0/511616012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c40103e00 0x7f6c4019a110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 >> 172.21.15.144:0/511616012 conn(0x7f6c400ff5b0 msgr2=0x7f6c401083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.471+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 shutdown_connections 2024-09-05T07:49:49.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:49.472+0000 7f6c48200640 1 -- 172.21.15.144:0/511616012 wait complete. 2024-09-05T07:49:50.355 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:49:50.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-05T07:49:50.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T07:49:50.437 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T07:49:50.438 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-05T07:49:50.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph mgr dump --format=json 2024-09-05T07:49:50.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:50 smithi144 ceph-mon[29535]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-05T07:49:50.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:50 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/511616012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:50 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:50 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T07:49:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:50 smithi154 ceph-mon[34710]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-05T07:49:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:50 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/511616012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:50 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:50 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T07:49:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:50 smithi175 ceph-mon[34585]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-05T07:49:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:50 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/511616012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:50 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T07:49:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:50 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T07:49:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 -- 172.21.15.144:0/1314818911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 msgr2=0x7f0a64104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 --2- 172.21.15.144:0/1314818911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64104210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009900 tx=0x7f0a5402a410 comp rx=0 tx=0).stop 2024-09-05T07:49:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 -- 172.21.15.144:0/1314818911 shutdown_connections 2024-09-05T07:49:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 --2- 172.21.15.144:0/1314818911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 0x7f0a64110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 --2- 172.21.15.144:0/1314818911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 --2- 172.21.15.144:0/1314818911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64104210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 -- 172.21.15.144:0/1314818911 >> 172.21.15.144:0/1314818911 conn(0x7f0a640ff8d0 msgr2=0x7f0a64101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:51.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 -- 172.21.15.144:0/1314818911 shutdown_connections 2024-09-05T07:49:51.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.431+0000 7f0a68c00640 1 -- 172.21.15.144:0/1314818911 wait complete. 2024-09-05T07:49:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.432+0000 7f0a68c00640 1 Processor -- start 2024-09-05T07:49:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.432+0000 7f0a68c00640 1 -- start start 2024-09-05T07:49:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 0x7f0a64077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64114010 con 0x7f0a641047e0 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64113e90 con 0x7f0a64108f60 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a68c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64114190 con 0x7f0a64103e30 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57638/0 (socket says 172.21.15.144:57638) 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 -- 172.21.15.144:0/683381901 learned_addr learned my addr 172.21.15.144:0/683381901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a63e00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 0x7f0a64077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a63400640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 -- 172.21.15.144:0/683381901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 msgr2=0x7f0a64076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 -- 172.21.15.144:0/683381901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 msgr2=0x7f0a64077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 0x7f0a64077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.433+0000 7f0a5be00640 1 -- 172.21.15.144:0/683381901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a641aaaf0 con 0x7f0a641047e0 2024-09-05T07:49:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a5be00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00ea90 tx=0x7f0a4c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00ce40 con 0x7f0a641047e0 2024-09-05T07:49:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a4c0035f0 con 0x7f0a641047e0 2024-09-05T07:49:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a641aade0 con 0x7f0a641047e0 2024-09-05T07:49:51.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c010690 con 0x7f0a641047e0 2024-09-05T07:49:51.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.434+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641ab240 con 0x7f0a641047e0 2024-09-05T07:49:51.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.435+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a64105310 con 0x7f0a641047e0 2024-09-05T07:49:51.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.438+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0a4c0037a0 con 0x7f0a641047e0 2024-09-05T07:49:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.439+0000 7f0a60c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 0x7f0a480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.439+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f0a4c0cf430 con 0x7f0a641047e0 2024-09-05T07:49:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.439+0000 7f0a63400640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 0x7f0a480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.440+0000 7f0a63400640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 0x7f0a480a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:51.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.443+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a4c09c2e0 con 0x7f0a641047e0 2024-09-05T07:49:51.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.668+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0a64077c30 con 0x7f0a641047e0 2024-09-05T07:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.673+0000 7f0a60c00640 1 -- 172.21.15.144:0/683381901 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263210 (secure 0 0 0) 0x7f0a4c09bbe0 con 0x7f0a641047e0 2024-09-05T07:49:51.678 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:51.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 msgr2=0x7f0a480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:51.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 0x7f0a480a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54005b50 comp rx=0 tx=0).stop 2024-09-05T07:49:51.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 msgr2=0x7f0a64076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00ea90 tx=0x7f0a4c00ef50 comp rx=0 tx=0).stop 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 shutdown_connections 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0a480a2c10 0x7f0a480a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a64108f60 0x7f0a64077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a641047e0 0x7f0a64076c40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 --2- 172.21.15.144:0/683381901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a64103e30 0x7f0a64076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 >> 172.21.15.144:0/683381901 conn(0x7f0a640ff8d0 msgr2=0x7f0a64100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 shutdown_connections 2024-09-05T07:49:51.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:51.678+0000 7f0a68c00640 1 -- 172.21.15.144:0/683381901 wait complete. 2024-09-05T07:49:52.393 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2361768482},{"type":"v1","addr":"172.21.15.144:6801","nonce":2361768482}]},"active_addr":"172.21.15.144:6801/2361768482","active_change":"2024-09-05T07:42:05.153902+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.144:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1926976677}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1108035631}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3727716755}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3832648059}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2354059791}]}]} 2024-09-05T07:49:52.399 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-05T07:49:52.399 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-05T07:49:52.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:49:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:52 smithi154 ceph-mon[34710]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-05T07:49:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:52 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/683381901' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T07:49:52.770 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:52 smithi144 ceph-mon[29535]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-05T07:49:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:52 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/683381901' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T07:49:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:52 smithi175 ceph-mon[34585]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-05T07:49:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:52 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/683381901' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 -- 172.21.15.144:0/3992993223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 msgr2=0x7fd65c110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 --2- 172.21.15.144:0/3992993223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c110810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd654009ca0 tx=0x7fd65402a950 comp rx=0 tx=0).stop 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 -- 172.21.15.144:0/3992993223 shutdown_connections 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 --2- 172.21.15.144:0/3992993223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074f40 0x7fd65c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 --2- 172.21.15.144:0/3992993223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c110810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 --2- 172.21.15.144:0/3992993223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074620 0x7fd65c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 -- 172.21.15.144:0/3992993223 >> 172.21.15.144:0/3992993223 conn(0x7fd65c0fd8c0 msgr2=0x7fd65c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 -- 172.21.15.144:0/3992993223 shutdown_connections 2024-09-05T07:49:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.326+0000 7fd661a00640 1 -- 172.21.15.144:0/3992993223 wait complete. 2024-09-05T07:49:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 Processor -- start 2024-09-05T07:49:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 -- start start 2024-09-05T07:49:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074620 0x7fd65c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074f40 0x7fd65c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1141b0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c114030 con 0x7fd65c074620 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.327+0000 7fd661a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c114330 con 0x7fd65c074f40 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33998/0 (socket says 172.21.15.144:33998) 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 -- 172.21.15.144:0/4077959687 learned_addr learned my addr 172.21.15.144:0/4077959687 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd653e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074f40 0x7fd65c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074620 0x7fd65c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 -- 172.21.15.144:0/4077959687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074f40 msgr2=0x7fd65c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074f40 0x7fd65c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 -- 172.21.15.144:0/4077959687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074620 msgr2=0x7fd65c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074620 0x7fd65c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 -- 172.21.15.144:0/4077959687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c19f5e0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.328+0000 7fd65b400640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd654009dc0 tx=0x7fd654003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.329+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654034040 con 0x7fd65c10e3c0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.329+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd654003e50 con 0x7fd65c10e3c0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.329+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6540046c0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.329+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c19f870 con 0x7fd65c10e3c0 2024-09-05T07:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.329+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c1a71b0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.330+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c074a00 con 0x7fd65c10e3c0 2024-09-05T07:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.332+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd654037020 con 0x7fd65c10e3c0 2024-09-05T07:49:53.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.333+0000 7fd653400640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 0x7fd6400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.333+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fd6540efe00 con 0x7fd65c10e3c0 2024-09-05T07:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.333+0000 7fd65aa00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 0x7fd6400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.334+0000 7fd65aa00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 0x7fd6400a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009bd0 tx=0x7fd64c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.337+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6540bcdc0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.517+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd65c109540 con 0x7fd65c10e3c0 2024-09-05T07:49:53.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.518+0000 7fd653400640 1 -- 172.21.15.144:0/4077959687 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22370 (secure 0 0 0) 0x7fd6540bc6c0 con 0x7fd65c10e3c0 2024-09-05T07:49:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:53.519 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:49:15.848324+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 msgr2=0x7fd6400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 0x7fd6400a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009bd0 tx=0x7fd64c005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 msgr2=0x7fd65c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd654009dc0 tx=0x7fd654003ce0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 shutdown_connections 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd6400a2c90 0x7fd6400a5150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c10e3c0 0x7fd65c19ef00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c074f40 0x7fd65c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 --2- 172.21.15.144:0/4077959687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c074620 0x7fd65c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.521+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 >> 172.21.15.144:0/4077959687 conn(0x7fd65c0fd8c0 msgr2=0x7fd65c0fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.522+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 shutdown_connections 2024-09-05T07:49:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:53.522+0000 7fd661a00640 1 -- 172.21.15.144:0/4077959687 wait complete. 2024-09-05T07:49:54.319 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-05T07:49:54.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:49:54.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:54 smithi144 ceph-mon[29535]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-05T07:49:54.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:54 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4077959687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:54 smithi154 ceph-mon[34710]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-05T07:49:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:54 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4077959687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:54.689 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:54 smithi175 ceph-mon[34585]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-05T07:49:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:54 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4077959687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:55.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 -- 172.21.15.144:0/2510179335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4108f60 msgr2=0x7f84e4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:55.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 --2- 172.21.15.144:0/2510179335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4108f60 0x7f84e4110ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009ca0 tx=0x7f84dc02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 -- 172.21.15.144:0/2510179335 shutdown_connections 2024-09-05T07:49:55.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 --2- 172.21.15.144:0/2510179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 --2- 172.21.15.144:0/2510179335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4108f60 0x7f84e4110ae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 --2- 172.21.15.144:0/2510179335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4103e30 0x7f84e4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 -- 172.21.15.144:0/2510179335 >> 172.21.15.144:0/2510179335 conn(0x7f84e40ff910 msgr2=0x7f84e4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 -- 172.21.15.144:0/2510179335 shutdown_connections 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.227+0000 7f84e9e00640 1 -- 172.21.15.144:0/2510179335 wait complete. 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.228+0000 7f84e9e00640 1 Processor -- start 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.228+0000 7f84e9e00640 1 -- start start 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.228+0000 7f84e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4108f60 0x7f84e419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4114010 con 0x7f84e4103e30 2024-09-05T07:49:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4113e90 con 0x7f84e41047e0 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4114190 con 0x7f84e4108f60 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34008/0 (socket says 172.21.15.144:34008) 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 -- 172.21.15.144:0/4129983172 learned_addr learned my addr 172.21.15.144:0/4129983172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e9400640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4108f60 0x7f84e419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84dbe00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 -- 172.21.15.144:0/4129983172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4108f60 msgr2=0x7f84e419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4108f60 0x7f84e419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 -- 172.21.15.144:0/4129983172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 msgr2=0x7f84e419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 -- 172.21.15.144:0/4129983172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e419f460 con 0x7f84e4103e30 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84dbe00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:49:55.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.229+0000 7f84e8a00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d950 tx=0x7f84d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.230+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4017030 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.230+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d4004020 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.230+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40047a0 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.230+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e419f750 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.230+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a7030 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.231+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e4105310 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.233+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f84d40041d0 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.234+0000 7f84e2000640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 0x7f84c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.234+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f84d40cea90 con 0x7f84e4103e30 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.234+0000 7f84dbe00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 0x7f84c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:55.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.235+0000 7f84dbe00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 0x7f84c80a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84e410a820 tx=0x7f84cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:55.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.238+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84d409b940 con 0x7f84e4103e30 2024-09-05T07:49:55.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.415+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84e4104210 con 0x7f84e4103e30 2024-09-05T07:49:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.416+0000 7f84e2000640 1 -- 172.21.15.144:0/4129983172 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22370 (secure 0 0 0) 0x7f84d409b240 con 0x7f84e4103e30 2024-09-05T07:49:55.417 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:49:55.418 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:49:15.848324+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:49:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 msgr2=0x7f84c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 0x7f84c80a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84e410a820 tx=0x7f84cc005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 msgr2=0x7f84e419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d950 tx=0x7f84d400de10 comp rx=0 tx=0).stop 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 shutdown_connections 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84c80a2c90 0x7f84c80a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e41047e0 0x7f84e419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4108f60 0x7f84e419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 --2- 172.21.15.144:0/4129983172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84e4103e30 0x7f84e419a4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 >> 172.21.15.144:0/4129983172 conn(0x7f84e40ff910 msgr2=0x7f84e4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 shutdown_connections 2024-09-05T07:49:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:55.419+0000 7f84e9e00640 1 -- 172.21.15.144:0/4129983172 wait complete. 2024-09-05T07:49:55.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:55 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4129983172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:55.818 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:55 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4129983172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:55 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4129983172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:49:56.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-05T07:49:56.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-05T07:49:56.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-05T07:49:56.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-05T07:49:56.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-05T07:49:56.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-05T07:49:56.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-05T07:49:56.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-05T07:49:56.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-05T07:49:56.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-05T07:49:56.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-05T07:49:56.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-05T07:49:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:56 smithi154 ceph-mon[34710]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:56.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:56 smithi144 ceph-mon[29535]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:56 smithi175 ceph-mon[34585]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:57.307 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.310 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.310 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.312 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.323 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.328 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.339 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.339 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:57.353 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:49:58.752 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:49:58 smithi144 ceph-mon[29535]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:49:58 smithi175 ceph-mon[34585]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:58.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:49:58 smithi154 ceph-mon[34710]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 -- 172.21.15.144:0/2348245646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c101de0 msgr2=0x7f125c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 --2- 172.21.15.144:0/2348245646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c101de0 0x7f125c1021c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f124c009900 tx=0x7f124c02a410 comp rx=0 tx=0).stop 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 -- 172.21.15.144:0/2348245646 shutdown_connections 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 --2- 172.21.15.144:0/2348245646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125c106f10 0x7f125c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 --2- 172.21.15.144:0/2348245646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c102790 0x7f125c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 --2- 172.21.15.144:0/2348245646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c101de0 0x7f125c1021c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.309+0000 7f1261200640 1 -- 172.21.15.144:0/2348245646 >> 172.21.15.144:0/2348245646 conn(0x7f125c0fd8c0 msgr2=0x7f125c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.310+0000 7f1261200640 1 -- 172.21.15.144:0/2348245646 shutdown_connections 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.310+0000 7f1261200640 1 -- 172.21.15.144:0/2348245646 wait complete. 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 Processor -- start 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 -- start start 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c101de0 0x7f125c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c102790 0x7f125c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125c106f10 0x7f125c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f125c111fc0 con 0x7f125c102790 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f125c111e40 con 0x7f125c106f10 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1261200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f125c112140 con 0x7f125c101de0 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.311+0000 7f1253e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c102790 0x7f125c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f125a800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125c106f10 0x7f125c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c101de0 0x7f125c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1253e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c102790 0x7f125c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34036/0 (socket says 172.21.15.144:34036) 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1253e00640 1 -- 172.21.15.144:0/1395170068 learned_addr learned my addr 172.21.15.144:0/1395170068 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 -- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125c106f10 msgr2=0x7f125c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125c106f10 0x7f125c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 -- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c102790 msgr2=0x7f125c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f125c102790 0x7f125c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c19d3f0 con 0x7f125c101de0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.312+0000 7f1259e00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c101de0 0x7f125c198440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f124c02a930 tx=0x7f124c003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.313+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c03f070 con 0x7f125c101de0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.313+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f124c031c90 con 0x7f125c101de0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.313+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c035030 con 0x7f125c101de0 2024-09-05T07:49:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.313+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125c19d680 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.313+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125c19db10 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.314+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f125c062940 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.316+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f124c042070 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.317+0000 7f1252a00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f12400a2c90 0x7f12400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.317+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f124c0effc0 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.317+0000 7f1253e00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f12400a2c90 0x7f12400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.318+0000 7f1252a00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] conn(0x7f12400ac4e0 0x7f12400ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.318+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f124c001d30 con 0x7f12400ac4e0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.318+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f124c0f0370 con 0x7f125c101de0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.318+0000 7f125a800640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] conn(0x7f12400ac4e0 0x7f12400ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.318+0000 7f1253e00640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f12400a2c90 0x7f12400a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f125c0fdd50 tx=0x7f1244005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.319+0000 7f125a800640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] conn(0x7f12400ac4e0 0x7f12400ae900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.319+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== osd.4 v2:172.21.15.154:6808/4185525506 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f124c001d30 con 0x7f12400ac4e0 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.334+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 --> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f125c062e10 con 0x7f12400ac4e0 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.334+0000 7f1252a00640 1 -- 172.21.15.144:0/1395170068 <== osd.4 v2:172.21.15.154:6808/4185525506 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f125c062e10 con 0x7f12400ac4e0 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] conn(0x7f12400ac4e0 msgr2=0x7f12400ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] conn(0x7f12400ac4e0 0x7f12400ae900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f12400a2c90 msgr2=0x7f12400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f12400a2c90 0x7f12400a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f125c0fdd50 tx=0x7f1244005f90 comp rx=0 tx=0).stop 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c101de0 msgr2=0x7f125c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 --2- 172.21.15.144:0/1395170068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c101de0 0x7f125c198440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f124c02a930 tx=0x7f124c003b20 comp rx=0 tx=0).stop 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f125a800640 1 -- 172.21.15.144:0/1395170068 reap_dead start 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 shutdown_connections 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 >> 172.21.15.144:0/1395170068 conn(0x7f125c0fd8c0 msgr2=0x7f125c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 shutdown_connections 2024-09-05T07:49:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.335+0000 7f1261200640 1 -- 172.21.15.144:0/1395170068 wait complete. 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 -- 172.21.15.144:0/600700795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8102b90 msgr2=0x7fc1a8102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 --2- 172.21.15.144:0/600700795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8102b90 0x7fc1a8102f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc198009900 tx=0x7fc19802a480 comp rx=0 tx=0).stop 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 -- 172.21.15.144:0/600700795 shutdown_connections 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 --2- 172.21.15.144:0/600700795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a81034b0 0x7fc1a810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 --2- 172.21.15.144:0/600700795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a810bfc0 0x7fc1a810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 --2- 172.21.15.144:0/600700795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8102b90 0x7fc1a8102f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 -- 172.21.15.144:0/600700795 >> 172.21.15.144:0/600700795 conn(0x7fc1a80fc610 msgr2=0x7fc1a80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 -- 172.21.15.144:0/600700795 shutdown_connections 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.428+0000 7fc1aca00640 1 -- 172.21.15.144:0/600700795 wait complete. 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 Processor -- start 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 -- start start 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8102b90 0x7fc1a819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 0x7fc1a819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a810bfc0 0x7fc1a819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111e10 con 0x7fc1a810bfc0 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111c90 con 0x7fc1a8102b90 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.429+0000 7fc1aca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111f90 con 0x7fc1a81034b0 2024-09-05T07:49:59.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 0x7fc1a819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc1a7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a810bfc0 0x7fc1a819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc1a6800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8102b90 0x7fc1a819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 0x7fc1a819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:52444/0 (socket says 172.21.15.144:52444) 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 -- 172.21.15.144:0/938727514 learned_addr learned my addr 172.21.15.144:0/938727514 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 -- 172.21.15.144:0/938727514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8102b90 msgr2=0x7fc1a819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8102b90 0x7fc1a819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 -- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a810bfc0 msgr2=0x7fc1a819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a810bfc0 0x7fc1a819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a819f480 con 0x7fc1a81034b0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc1a6800640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8102b90 0x7fc1a819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.430+0000 7fc19de00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 0x7fc1a819aa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc19000e9f0 tx=0x7fc19000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19000ccc0 con 0x7fc1a81034b0 2024-09-05T07:49:59.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a819f770 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc190010910 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190018920 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a81a7050 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.431+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1a80fec80 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.434+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc190010430 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc19fe00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc18c0a2c10 0x7fc18c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc1a6800640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc18c0a2c10 0x7fc18c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fc1900cfbc0 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc19fe00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] conn(0x7fc18c0ac460 0x7fc18c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc190023e50 con 0x7fc18c0ac460 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.436+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc1900cff70 con 0x7fc1a81034b0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.437+0000 7fc1a7200640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] conn(0x7fc18c0ac460 0x7fc18c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:49:59.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.437+0000 7fc1a6800640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc18c0a2c10 0x7fc18c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc198000c00 tx=0x7fc198031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.437+0000 7fc1a7200640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] conn(0x7fc18c0ac460 0x7fc18c0ae880 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.438+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== osd.5 v2:172.21.15.175:6808/3675433893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc190023e50 con 0x7fc18c0ac460 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.453+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 --> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1a806a850 con 0x7fc18c0ac460 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc19fe00640 1 -- 172.21.15.144:0/938727514 <== osd.5 v2:172.21.15.175:6808/3675433893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1a806a850 con 0x7fc18c0ac460 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] conn(0x7fc18c0ac460 msgr2=0x7fc18c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] conn(0x7fc18c0ac460 0x7fc18c0ae880 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc18c0a2c10 msgr2=0x7fc18c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc18c0a2c10 0x7fc18c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc198000c00 tx=0x7fc198031510 comp rx=0 tx=0).stop 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 msgr2=0x7fc1a819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 --2- 172.21.15.144:0/938727514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a81034b0 0x7fc1a819aa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc19000e9f0 tx=0x7fc19000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1a7200640 1 -- 172.21.15.144:0/938727514 reap_dead start 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 shutdown_connections 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 >> 172.21.15.144:0/938727514 conn(0x7fc1a80fc610 msgr2=0x7fc1a80fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.454+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 shutdown_connections 2024-09-05T07:49:59.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:49:59.455+0000 7fc1aca00640 1 -- 172.21.15.144:0/938727514 wait complete. 2024-09-05T07:50:00.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 -- 172.21.15.144:0/4256522683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8101de0 msgr2=0x7f24b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 --2- 172.21.15.144:0/4256522683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8101de0 0x7f24b81021c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009ca0 tx=0x7f24a802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 -- 172.21.15.144:0/4256522683 shutdown_connections 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 --2- 172.21.15.144:0/4256522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8106f10 0x7f24b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 --2- 172.21.15.144:0/4256522683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b8102790 0x7f24b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 --2- 172.21.15.144:0/4256522683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8101de0 0x7f24b81021c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 -- 172.21.15.144:0/4256522683 >> 172.21.15.144:0/4256522683 conn(0x7f24b80fd8c0 msgr2=0x7f24b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.175+0000 7f24be400640 1 -- 172.21.15.144:0/4256522683 shutdown_connections 2024-09-05T07:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.176+0000 7f24be400640 1 -- 172.21.15.144:0/4256522683 wait complete. 2024-09-05T07:50:00.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.176+0000 7f24be400640 1 Processor -- start 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 -- start start 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8101de0 0x7f24b819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8102790 0x7f24b819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b8106f10 0x7f24b819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8111f70 con 0x7f24b8102790 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8111df0 con 0x7f24b8101de0 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24be400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f24b81120f0 con 0x7f24b8106f10 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8102790 0x7f24b819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8102790 0x7f24b819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34066/0 (socket says 172.21.15.144:34066) 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24b6a00640 1 -- 172.21.15.144:0/63232722 learned_addr learned my addr 172.21.15.144:0/63232722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24b7400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8101de0 0x7f24b819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.177+0000 7f24b7e00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b8106f10 0x7f24b819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 -- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b8106f10 msgr2=0x7f24b819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b8106f10 0x7f24b819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 -- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8102790 msgr2=0x7f24b819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8102790 0x7f24b819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b819f5f0 con 0x7f24b8101de0 2024-09-05T07:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24b7400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8101de0 0x7f24b819a640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000f80 tx=0x7f24a80319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a802fa20 con 0x7f24b8101de0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b819f880 con 0x7f24b8101de0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24a802f380 con 0x7f24b8101de0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.178+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a803a660 con 0x7f24b8101de0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.179+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81a71c0 con 0x7f24b8101de0 2024-09-05T07:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.180+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24b8075780 con 0x7f24b8101de0 2024-09-05T07:50:00.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.182+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f24a80305c0 con 0x7f24b8101de0 2024-09-05T07:50:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.184+0000 7f24afe00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f249c0a2c10 0x7f249c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.184+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f24a80f0240 con 0x7f24b8101de0 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.184+0000 7f24b6a00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f249c0a2c10 0x7f249c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24afe00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] conn(0x7f249c0ac460 0x7f249c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24a8005a20 con 0x7f249c0ac460 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f24a80f7050 con 0x7f24b8101de0 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24b7e00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] conn(0x7f249c0ac460 0x7f249c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24b6a00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f249c0a2c10 0x7f249c0a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24b80fe1a0 tx=0x7f24a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.185+0000 7f24b7e00640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] conn(0x7f249c0ac460 0x7f249c0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.186+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== osd.2 v2:172.21.15.175:6800/1799064874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24a8005a20 con 0x7f249c0ac460 2024-09-05T07:50:00.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.200+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 --> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f24b81032c0 con 0x7f249c0ac460 2024-09-05T07:50:00.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24afe00640 1 -- 172.21.15.144:0/63232722 <== osd.2 v2:172.21.15.175:6800/1799064874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f24b81032c0 con 0x7f249c0ac460 2024-09-05T07:50:00.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] conn(0x7f249c0ac460 msgr2=0x7f249c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] conn(0x7f249c0ac460 0x7f249c0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f249c0a2c10 msgr2=0x7f249c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f249c0a2c10 0x7f249c0a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24b80fe1a0 tx=0x7f24a4005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8101de0 msgr2=0x7f24b819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 --2- 172.21.15.144:0/63232722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b8101de0 0x7f24b819a640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000f80 tx=0x7f24a80319f0 comp rx=0 tx=0).stop 2024-09-05T07:50:00.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24b7e00640 1 -- 172.21.15.144:0/63232722 reap_dead start 2024-09-05T07:50:00.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 shutdown_connections 2024-09-05T07:50:00.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.201+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 >> 172.21.15.144:0/63232722 conn(0x7f24b80fd8c0 msgr2=0x7f24b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:00.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.202+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 shutdown_connections 2024-09-05T07:50:00.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.202+0000 7f24be400640 1 -- 172.21.15.144:0/63232722 wait complete. 2024-09-05T07:50:00.589 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:00 smithi144 ceph-mon[29535]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T07:50:00.589 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:00 smithi144 ceph-mon[29535]: overall HEALTH_OK 2024-09-05T07:50:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:00 smithi175 ceph-mon[34585]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T07:50:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:00 smithi175 ceph-mon[34585]: overall HEALTH_OK 2024-09-05T07:50:00.905 INFO:teuthology.orchestra.run.smithi144.stdout:137438953531 2024-09-05T07:50:00.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-05T07:50:00.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:00 smithi154 ceph-mon[34710]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T07:50:00.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:00 smithi154 ceph-mon[34710]: overall HEALTH_OK 2024-09-05T07:50:01.566 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:01.566 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:01.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.683+0000 7efedac00640 1 -- 172.21.15.144:0/468248723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed41049a0 msgr2=0x7efed41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.683+0000 7efedac00640 1 --2- 172.21.15.144:0/468248723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed41049a0 0x7efed41089f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efec4009900 tx=0x7efec402a440 comp rx=0 tx=0).stop 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 -- 172.21.15.144:0/468248723 shutdown_connections 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 --2- 172.21.15.144:0/468248723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4109120 0x7efed4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 --2- 172.21.15.144:0/468248723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed41049a0 0x7efed41089f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 --2- 172.21.15.144:0/468248723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efed4103ff0 0x7efed41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 -- 172.21.15.144:0/468248723 >> 172.21.15.144:0/468248723 conn(0x7efed40ffab0 msgr2=0x7efed4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 -- 172.21.15.144:0/468248723 shutdown_connections 2024-09-05T07:50:01.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.684+0000 7efedac00640 1 -- 172.21.15.144:0/468248723 wait complete. 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 Processor -- start 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 -- start start 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efed4103ff0 0x7efed419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 0x7efed419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed4109120 0x7efed419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efed41141c0 con 0x7efed4109120 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efed4114040 con 0x7efed4103ff0 2024-09-05T07:50:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.685+0000 7efedac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efed4114340 con 0x7efed41049a0 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 0x7efed419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed4109120 0x7efed419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 0x7efed419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:52496/0 (socket says 172.21.15.144:52496) 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 -- 172.21.15.144:0/2037892075 learned_addr learned my addr 172.21.15.144:0/2037892075 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3e00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efed4103ff0 0x7efed419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 -- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efed4103ff0 msgr2=0x7efed419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efed4103ff0 0x7efed419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 -- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed4109120 msgr2=0x7efed419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efed4109120 0x7efed419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.686+0000 7efed3400640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed419f670 con 0x7efed41049a0 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efed3400640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 0x7efed419ac00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec4005ab0 tx=0x7efec40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec403f030 con 0x7efed41049a0 2024-09-05T07:50:01.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed419f900 con 0x7efed41049a0 2024-09-05T07:50:01.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec4003ce0 con 0x7efed41049a0 2024-09-05T07:50:01.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4035070 con 0x7efed41049a0 2024-09-05T07:50:01.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.687+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed41a7240 con 0x7efed41049a0 2024-09-05T07:50:01.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.688+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efed4062980 con 0x7efed41049a0 2024-09-05T07:50:01.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.690+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efec4042030 con 0x7efed41049a0 2024-09-05T07:50:01.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed0c00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efeb80a2c10 0x7efeb80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7efec40efc50 con 0x7efed41049a0 2024-09-05T07:50:01.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed3e00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efeb80a2c10 0x7efeb80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed0c00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] conn(0x7efeb80ac460 0x7efeb80ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efec4003b30 con 0x7efeb80ac460 2024-09-05T07:50:01.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.692+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7efec40f0000 con 0x7efed41049a0 2024-09-05T07:50:01.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.693+0000 7efed8c00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] conn(0x7efeb80ac460 0x7efeb80ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.693+0000 7efed3e00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efeb80a2c10 0x7efeb80a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efebc00bbe0 tx=0x7efebc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.693+0000 7efed8c00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] conn(0x7efeb80ac460 0x7efeb80ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.694+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== osd.1 v2:172.21.15.154:6800/3510298386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efec4003b30 con 0x7efeb80ac460 2024-09-05T07:50:01.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.714+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 --> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efed4062d80 con 0x7efeb80ac460 2024-09-05T07:50:01.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.715+0000 7efed0c00640 1 -- 172.21.15.144:0/2037892075 <== osd.1 v2:172.21.15.154:6800/3510298386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efed4062d80 con 0x7efeb80ac460 2024-09-05T07:50:01.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.715+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] conn(0x7efeb80ac460 msgr2=0x7efeb80ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.715+0000 7efedac00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] conn(0x7efeb80ac460 0x7efeb80ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efeb80a2c10 msgr2=0x7efeb80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efeb80a2c10 0x7efeb80a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efebc00bbe0 tx=0x7efebc00b390 comp rx=0 tx=0).stop 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 msgr2=0x7efed419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 --2- 172.21.15.144:0/2037892075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed41049a0 0x7efed419ac00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec4005ab0 tx=0x7efec40042f0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efed8c00640 1 -- 172.21.15.144:0/2037892075 reap_dead start 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 shutdown_connections 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 >> 172.21.15.144:0/2037892075 conn(0x7efed40ffab0 msgr2=0x7efed4100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 shutdown_connections 2024-09-05T07:50:01.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:01.716+0000 7efedac00640 1 -- 172.21.15.144:0/2037892075 wait complete. 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 -- 172.21.15.144:0/4246798501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5208102360 msgr2=0x7f520810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 --2- 172.21.15.144:0/4246798501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5208102360 0x7f520810e890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5200009cd0 tx=0x7f520002a8e0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 -- 172.21.15.144:0/4246798501 shutdown_connections 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 --2- 172.21.15.144:0/4246798501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52081019c0 0x7f5208101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 --2- 172.21.15.144:0/4246798501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5208102360 0x7f520810e890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 --2- 172.21.15.144:0/4246798501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52081079c0 0x7f5208107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 -- 172.21.15.144:0/4246798501 >> 172.21.15.144:0/4246798501 conn(0x7f52080fd740 msgr2=0x7f52080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 -- 172.21.15.144:0/4246798501 shutdown_connections 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.551+0000 7f520da00640 1 -- 172.21.15.144:0/4246798501 wait complete. 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 Processor -- start 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 -- start start 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52081019c0 0x7f5208198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5208102360 0x7f52081987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 0x7f520819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111e10 con 0x7f52081079c0 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111c90 con 0x7f5208102360 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.552+0000 7f520da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111f90 con 0x7f52081019c0 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 0x7f520819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 0x7f520819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34090/0 (socket says 172.21.15.144:34090) 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 -- 172.21.15.144:0/716895749 learned_addr learned my addr 172.21.15.144:0/716895749 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f5207e00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52081019c0 0x7f5208198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f5207400640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5208102360 0x7f52081987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 -- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52081019c0 msgr2=0x7f5208198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52081019c0 0x7f5208198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 -- 172.21.15.144:0/716895749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5208102360 msgr2=0x7f52081987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5208102360 0x7f52081987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520819d240 con 0x7f52081079c0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f5207400640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5208102360 0x7f52081987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.553+0000 7f520d000640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 0x7f520819cb60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5200033040 tx=0x7f5200031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.554+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200004040 con 0x7f52081079c0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.554+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52000046c0 con 0x7f52081079c0 2024-09-05T07:50:01.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.554+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520819d4d0 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.554+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200030ed0 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.554+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52081a4e10 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.555+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5208062980 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.557+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f52000041e0 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5204c00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f51ec0a2c10 0x7f51ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f520002e030 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5207e00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f51ec0a2c10 0x7f51ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5204c00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] conn(0x7f51ec0ac460 0x7f51ec0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f520004fe50 con 0x7f51ec0ac460 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.558+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f52000f0b80 con 0x7f52081079c0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.559+0000 7f5207400640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] conn(0x7f51ec0ac460 0x7f51ec0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:01.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.559+0000 7f5207e00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f51ec0a2c10 0x7f51ec0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009b50 tx=0x7f51f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.559+0000 7f5207400640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] conn(0x7f51ec0ac460 0x7f51ec0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.560+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== osd.8 v2:172.21.15.175:6816/1421352670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f520004fe50 con 0x7f51ec0ac460 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.574+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 --> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5208062e00 con 0x7f51ec0ac460 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.575+0000 7f5204c00640 1 -- 172.21.15.144:0/716895749 <== osd.8 v2:172.21.15.175:6816/1421352670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5208062e00 con 0x7f51ec0ac460 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.575+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] conn(0x7f51ec0ac460 msgr2=0x7f51ec0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.575+0000 7f520da00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] conn(0x7f51ec0ac460 0x7f51ec0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:01.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f51ec0a2c10 msgr2=0x7f51ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f51ec0a2c10 0x7f51ec0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009b50 tx=0x7f51f8005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 msgr2=0x7f520819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 --2- 172.21.15.144:0/716895749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52081079c0 0x7f520819cb60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5200033040 tx=0x7f5200031e60 comp rx=0 tx=0).stop 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520d000640 1 -- 172.21.15.144:0/716895749 reap_dead start 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 shutdown_connections 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 >> 172.21.15.144:0/716895749 conn(0x7f52080fd740 msgr2=0x7f52080fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 shutdown_connections 2024-09-05T07:50:01.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:00.576+0000 7f520da00640 1 -- 172.21.15.144:0/716895749 wait complete. 2024-09-05T07:50:02.676 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:02 smithi144 ceph-mon[29535]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T07:50:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:02 smithi175 ceph-mon[34585]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T07:50:02.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:02 smithi154 ceph-mon[34710]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 -- 172.21.15.144:0/489314595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50103ff0 msgr2=0x7f8b501043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 --2- 172.21.15.144:0/489314595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50103ff0 0x7f8b501043d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009900 tx=0x7f8b4402a410 comp rx=0 tx=0).stop 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 -- 172.21.15.144:0/489314595 shutdown_connections 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 --2- 172.21.15.144:0/489314595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b501089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 --2- 172.21.15.144:0/489314595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50109120 0x7f8b50110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 --2- 172.21.15.144:0/489314595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50103ff0 0x7f8b501043d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 -- 172.21.15.144:0/489314595 >> 172.21.15.144:0/489314595 conn(0x7f8b500ffa90 msgr2=0x7f8b50101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 -- 172.21.15.144:0/489314595 shutdown_connections 2024-09-05T07:50:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.010+0000 7f8b58400640 1 -- 172.21.15.144:0/489314595 wait complete. 2024-09-05T07:50:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.011+0000 7f8b58400640 1 Processor -- start 2024-09-05T07:50:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.011+0000 7f8b58400640 1 -- start start 2024-09-05T07:50:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50103ff0 0x7f8b5019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b5019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50109120 0x7f8b5019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b50114170 con 0x7f8b50109120 2024-09-05T07:50:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b50113ff0 con 0x7f8b501049a0 2024-09-05T07:50:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b58400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b501142f0 con 0x7f8b50103ff0 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b56400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50109120 0x7f8b5019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50103ff0 0x7f8b5019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b5019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b5019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35324/0 (socket says 172.21.15.144:35324) 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b56400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50109120 0x7f8b5019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53256/0 (socket says 172.21.15.144:53256) 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 -- 172.21.15.144:0/2736396191 learned_addr learned my addr 172.21.15.144:0/2736396191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50103ff0 0x7f8b5019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:44970/0 (socket says 172.21.15.144:44970) 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 -- 172.21.15.144:0/2736396191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50103ff0 msgr2=0x7f8b5019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b50103ff0 0x7f8b5019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 -- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50109120 msgr2=0x7f8b5019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.012+0000 7f8b55000640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50109120 0x7f8b5019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b55000640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5019f5b0 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b55000640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b5019ab40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00e9f0 tx=0x7f8b3c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00cd80 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5019f8a0 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c010910 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0188f0 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.013+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b501a7180 con 0x7f8b501049a0 2024-09-05T07:50:03.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.014+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b50062980 con 0x7f8b501049a0 2024-09-05T07:50:03.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.016+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8b3c010ac0 con 0x7f8b501049a0 2024-09-05T07:50:03.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.018+0000 7f8b4e000640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8b380a2c90 0x7f8b380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:03.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.018+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f8b3c0cfad0 con 0x7f8b501049a0 2024-09-05T07:50:03.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b55a00640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8b380a2c90 0x7f8b380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b4e000640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] conn(0x7f8b380ac4e0 0x7f8b380ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b380aefb0 con 0x7f8b380ac4e0 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c0cfe80 con 0x7f8b501049a0 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b56400640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] conn(0x7f8b380ac4e0 0x7f8b380ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.019+0000 7f8b55a00640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8b380a2c90 0x7f8b380a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b44005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:03.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.020+0000 7f8b56400640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] conn(0x7f8b380ac4e0 0x7f8b380ae900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:03.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.020+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== osd.0 v2:172.21.15.144:6802/1617602534 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b380aefb0 con 0x7f8b380ac4e0 2024-09-05T07:50:03.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.035+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 --> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b50062d80 con 0x7f8b380ac4e0 2024-09-05T07:50:03.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b4e000640 1 -- 172.21.15.144:0/2736396191 <== osd.0 v2:172.21.15.144:6802/1617602534 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b50062d80 con 0x7f8b380ac4e0 2024-09-05T07:50:03.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] conn(0x7f8b380ac4e0 msgr2=0x7f8b380ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] conn(0x7f8b380ac4e0 0x7f8b380ae900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8b380a2c90 msgr2=0x7f8b380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8b380a2c90 0x7f8b380a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b44005b50 comp rx=0 tx=0).stop 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 msgr2=0x7f8b5019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 --2- 172.21.15.144:0/2736396191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b501049a0 0x7f8b5019ab40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00e9f0 tx=0x7f8b3c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b56400640 1 -- 172.21.15.144:0/2736396191 reap_dead start 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 shutdown_connections 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.036+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 >> 172.21.15.144:0/2736396191 conn(0x7f8b500ffa90 msgr2=0x7f8b50100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.037+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 shutdown_connections 2024-09-05T07:50:03.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:03.037+0000 7f8b58400640 1 -- 172.21.15.144:0/2736396191 wait complete. 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.394+0000 7fe27c600640 1 -- 172.21.15.144:0/876729572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 msgr2=0x7fe274110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.394+0000 7fe27c600640 1 --2- 172.21.15.144:0/876729572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 0x7fe274110ca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009ca0 tx=0x7fe26c02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 -- 172.21.15.144:0/876729572 shutdown_connections 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 --2- 172.21.15.144:0/876729572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2741049a0 0x7fe2741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 --2- 172.21.15.144:0/876729572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 0x7fe274110ca0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 --2- 172.21.15.144:0/876729572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe274103ff0 0x7fe2741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 -- 172.21.15.144:0/876729572 >> 172.21.15.144:0/876729572 conn(0x7fe2740ffa90 msgr2=0x7fe274101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 -- 172.21.15.144:0/876729572 shutdown_connections 2024-09-05T07:50:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.395+0000 7fe27c600640 1 -- 172.21.15.144:0/876729572 wait complete. 2024-09-05T07:50:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.396+0000 7fe27c600640 1 Processor -- start 2024-09-05T07:50:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.396+0000 7fe27c600640 1 -- start start 2024-09-05T07:50:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.396+0000 7fe27c600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274103ff0 0x7fe27419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27c600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 0x7fe27419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 0x7fe27419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2741141a0 con 0x7fe274109120 2024-09-05T07:50:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27c600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe274114020 con 0x7fe274103ff0 2024-09-05T07:50:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27c600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe274114320 con 0x7fe2741049a0 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 0x7fe27419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe27a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 0x7fe27419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 0x7fe27419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:44988/0 (socket says 172.21.15.144:44988) 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 -- 172.21.15.144:0/4093328025 learned_addr learned my addr 172.21.15.144:0/4093328025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279c00640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274103ff0 0x7fe27419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 -- 172.21.15.144:0/4093328025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274103ff0 msgr2=0x7fe27419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274103ff0 0x7fe27419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 -- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 msgr2=0x7fe27419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe274109120 0x7fe27419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279200640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27419f590 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.397+0000 7fe279c00640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274103ff0 0x7fe27419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe279200640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 0x7fe27419ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe26000e9f0 tx=0x7fe26000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26000cd80 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe260010910 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27419f880 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260018990 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.398+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2741a7160 con 0x7fe2741049a0 2024-09-05T07:50:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.399+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe274101020 con 0x7fe2741049a0 2024-09-05T07:50:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.401+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe260010ac0 con 0x7fe2741049a0 2024-09-05T07:50:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.402+0000 7fe272000640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe25c0a2c90 0x7fe25c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7fe2600cf990 con 0x7fe2741049a0 2024-09-05T07:50:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe279c00640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe25c0a2c90 0x7fe25c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe272000640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] conn(0x7fe25c0ac4e0 0x7fe25c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe25c0aefb0 con 0x7fe25c0ac4e0 2024-09-05T07:50:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe2600cfd40 con 0x7fe2741049a0 2024-09-05T07:50:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe279c00640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe25c0a2c90 0x7fe25c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe268009fc0 tx=0x7fe268005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.403+0000 7fe27a600640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] conn(0x7fe25c0ac4e0 0x7fe25c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.404+0000 7fe27a600640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] conn(0x7fe25c0ac4e0 0x7fe25c0ae900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.405+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== osd.11 v2:172.21.15.175:6824/3823820862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe25c0aefb0 con 0x7fe25c0ac4e0 2024-09-05T07:50:04.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.419+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 --> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2741054d0 con 0x7fe25c0ac4e0 2024-09-05T07:50:04.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.420+0000 7fe272000640 1 -- 172.21.15.144:0/4093328025 <== osd.11 v2:172.21.15.175:6824/3823820862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe2741054d0 con 0x7fe25c0ac4e0 2024-09-05T07:50:04.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.420+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] conn(0x7fe25c0ac4e0 msgr2=0x7fe25c0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.420+0000 7fe27c600640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] conn(0x7fe25c0ac4e0 0x7fe25c0ae900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe25c0a2c90 msgr2=0x7fe25c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe25c0a2c90 0x7fe25c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe268009fc0 tx=0x7fe268005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 msgr2=0x7fe27419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 --2- 172.21.15.144:0/4093328025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2741049a0 0x7fe27419ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe26000e9f0 tx=0x7fe26000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27a600640 1 -- 172.21.15.144:0/4093328025 reap_dead start 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 shutdown_connections 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 >> 172.21.15.144:0/4093328025 conn(0x7fe2740ffa90 msgr2=0x7fe2741005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 shutdown_connections 2024-09-05T07:50:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:04.421+0000 7fe27c600640 1 -- 172.21.15.144:0/4093328025 wait complete. 2024-09-05T07:50:04.536 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:04 smithi144 ceph-mon[29535]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:50:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:04 smithi175 ceph-mon[34585]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:50:04.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:04 smithi154 ceph-mon[34710]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:50:05.011 INFO:teuthology.orchestra.run.smithi144.stdout:77309411399 2024-09-05T07:50:05.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-05T07:50:05.556 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-05T07:50:05.557 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-05T07:50:05.557 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:05 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.562+0000 7f6423400640 1 -- 172.21.15.144:0/3234785340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c102790 msgr2=0x7f641c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.562+0000 7f6423400640 1 --2- 172.21.15.144:0/3234785340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c102790 0x7f641c1067e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6408009900 tx=0x7f640802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 -- 172.21.15.144:0/3234785340 shutdown_connections 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 --2- 172.21.15.144:0/3234785340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106f10 0x7f641c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 --2- 172.21.15.144:0/3234785340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c102790 0x7f641c1067e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 --2- 172.21.15.144:0/3234785340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 -- 172.21.15.144:0/3234785340 >> 172.21.15.144:0/3234785340 conn(0x7f641c0fd8c0 msgr2=0x7f641c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 -- 172.21.15.144:0/3234785340 shutdown_connections 2024-09-05T07:50:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.563+0000 7f6423400640 1 -- 172.21.15.144:0/3234785340 wait complete. 2024-09-05T07:50:05.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 Processor -- start 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 -- start start 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c102790 0x7f641c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c106f10 0x7f641c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f641c111f70 con 0x7f641c106f10 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f641c111df0 con 0x7f641c101de0 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6423400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f641c1120f0 con 0x7f641c102790 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6420a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6421400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c106f10 0x7f641c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6420a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35364/0 (socket says 172.21.15.144:35364) 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.564+0000 7f6420a00640 1 -- 172.21.15.144:0/2137189124 learned_addr learned my addr 172.21.15.144:0/2137189124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f641be00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c102790 0x7f641c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:05.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 -- 172.21.15.144:0/2137189124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c102790 msgr2=0x7f641c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c102790 0x7f641c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 -- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c106f10 msgr2=0x7f641c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c106f10 0x7f641c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c19f620 con 0x7f641c101de0 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6421400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f641c106f10 0x7f641c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6420a00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c19a670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f641000e9f0 tx=0x7f641000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000cd80 con 0x7f641c101de0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c19f910 con 0x7f641c101de0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.565+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6410010910 con 0x7f641c101de0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.566+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64100188f0 con 0x7f641c101de0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.566+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c1a71f0 con 0x7f641c101de0 2024-09-05T07:50:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.566+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f641c0fef40 con 0x7f641c101de0 2024-09-05T07:50:05.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.569+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6410010ac0 con 0x7f641c101de0 2024-09-05T07:50:05.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f6419600640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64040a2c90 0x7f64040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:05.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f64100cfb90 con 0x7f641c101de0 2024-09-05T07:50:05.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f641be00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64040a2c90 0x7f64040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:05.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f6419600640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] conn(0x7f64040ac8c0 0x7f64040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:05.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64040af430 con 0x7f64040ac8c0 2024-09-05T07:50:05.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.570+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f64100cffe0 con 0x7f641c101de0 2024-09-05T07:50:05.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.571+0000 7f6421400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] conn(0x7f64040ac8c0 0x7f64040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:05.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.571+0000 7f641be00640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64040a2c90 0x7f64040a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6408009230 tx=0x7f64080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:05.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.571+0000 7f6421400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] conn(0x7f64040ac8c0 0x7f64040aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:05.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.572+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== osd.3 v2:172.21.15.144:6810/827690794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64040af430 con 0x7f64040ac8c0 2024-09-05T07:50:05.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.586+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 --> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f641c1032c0 con 0x7f64040ac8c0 2024-09-05T07:50:05.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6419600640 1 -- 172.21.15.144:0/2137189124 <== osd.3 v2:172.21.15.144:6810/827690794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f641c1032c0 con 0x7f64040ac8c0 2024-09-05T07:50:05.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] conn(0x7f64040ac8c0 msgr2=0x7f64040aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] conn(0x7f64040ac8c0 0x7f64040aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64040a2c90 msgr2=0x7f64040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64040a2c90 0x7f64040a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6408009230 tx=0x7f64080058d0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 msgr2=0x7f641c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 --2- 172.21.15.144:0/2137189124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c101de0 0x7f641c19a670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f641000e9f0 tx=0x7f641000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6421400640 1 -- 172.21.15.144:0/2137189124 reap_dead start 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 shutdown_connections 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.587+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 >> 172.21.15.144:0/2137189124 conn(0x7f641c0fd8c0 msgr2=0x7f641c0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.588+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 shutdown_connections 2024-09-05T07:50:05.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.588+0000 7f6423400640 1 -- 172.21.15.144:0/2137189124 wait complete. 2024-09-05T07:50:05.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]: dispatch 2024-09-05T07:50:05.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-05T07:50:05.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-05T07:50:05.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:05 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-05T07:50:05.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]: dispatch 2024-09-05T07:50:05.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-05T07:50:05.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-05T07:50:05.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-05T07:50:05.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-05T07:50:05.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-05T07:50:05.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-05T07:50:05.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:05 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-05T07:50:06.064 INFO:teuthology.orchestra.run.smithi144.stdout:34359738448 2024-09-05T07:50:06.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-05T07:50:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 -- 172.21.15.144:0/1918113601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 msgr2=0x7f7890110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 --2- 172.21.15.144:0/1918113601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 0x7f7890110650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7888009ca0 tx=0x7f788802a950 comp rx=0 tx=0).stop 2024-09-05T07:50:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 -- 172.21.15.144:0/1918113601 shutdown_connections 2024-09-05T07:50:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 --2- 172.21.15.144:0/1918113601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 0x7f7890110650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 --2- 172.21.15.144:0/1918113601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7890074ee0 0x7f789010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 --2- 172.21.15.144:0/1918113601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f78900749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 -- 172.21.15.144:0/1918113601 >> 172.21.15.144:0/1918113601 conn(0x7f78900fd740 msgr2=0x7f78900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 -- 172.21.15.144:0/1918113601 shutdown_connections 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.504+0000 7f7895e00640 1 -- 172.21.15.144:0/1918113601 wait complete. 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.505+0000 7f7895e00640 1 Processor -- start 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.505+0000 7f7895e00640 1 -- start start 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f789019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7890074ee0 0x7f789019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 0x7f789019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7890113fb0 con 0x7f789010e260 2024-09-05T07:50:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7890113e30 con 0x7f78900745c0 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7890114130 con 0x7f7890074ee0 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f789019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7895400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 0x7f789019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f789019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35408/0 (socket says 172.21.15.144:35408) 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 -- 172.21.15.144:0/4153721259 learned_addr learned my addr 172.21.15.144:0/4153721259 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f788fe00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7890074ee0 0x7f789019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 -- 172.21.15.144:0/4153721259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7890074ee0 msgr2=0x7f789019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7890074ee0 0x7f789019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 -- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 msgr2=0x7f789019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f789010e260 0x7f789019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.506+0000 7f7894a00640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789019f420 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f7894a00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f789019a470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f788400d950 tx=0x7f788400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884017030 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7884004020 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789019f710 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840047a0 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.507+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78901a6ff0 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.508+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7890062940 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.511+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f78840041d0 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788d600640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f78780a2c10 0x7f78780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f78840cf240 con 0x7f78900745c0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788fe00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f78780a2c10 0x7f78780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788d600640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] conn(0x7f78780ac840 0x7f78780aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78780af3b0 con 0x7f78780ac840 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.512+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f78840cf5f0 con 0x7f78900745c0 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.513+0000 7f7895400640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] conn(0x7f78780ac840 0x7f78780aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.513+0000 7f788fe00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f78780a2c10 0x7f78780a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f789010f5f0 tx=0x7f787c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.513+0000 7f7895400640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] conn(0x7f78780ac840 0x7f78780aece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.514+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== osd.9 v2:172.21.15.144:6826/2500230647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78780af3b0 con 0x7f78780ac840 2024-09-05T07:50:06.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.529+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 --> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7890062dc0 con 0x7f78780ac840 2024-09-05T07:50:06.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.529+0000 7f788d600640 1 -- 172.21.15.144:0/4153721259 <== osd.9 v2:172.21.15.144:6826/2500230647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7890062dc0 con 0x7f78780ac840 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] conn(0x7f78780ac840 msgr2=0x7f78780aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] conn(0x7f78780ac840 0x7f78780aece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f78780a2c10 msgr2=0x7f78780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f78780a2c10 0x7f78780a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f789010f5f0 tx=0x7f787c005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 msgr2=0x7f789019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 --2- 172.21.15.144:0/4153721259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78900745c0 0x7f789019a470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f788400d950 tx=0x7f788400de10 comp rx=0 tx=0).stop 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895400640 1 -- 172.21.15.144:0/4153721259 reap_dead start 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 shutdown_connections 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 >> 172.21.15.144:0/4153721259 conn(0x7f78900fd740 msgr2=0x7f78900fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 shutdown_connections 2024-09-05T07:50:06.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:06.530+0000 7f7895e00640 1 -- 172.21.15.144:0/4153721259 wait complete. 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]': finished 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-05T07:50:06.648 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-05T07:50:06.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-05T07:50:06.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-05T07:50:06.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-05T07:50:06.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-05T07:50:06.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:06 smithi144 ceph-mon[29535]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T07:50:06.650 INFO:teuthology.orchestra.run.smithi144.stdout:244813135911 2024-09-05T07:50:06.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-05T07:50:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 -- 172.21.15.144:0/632060600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 msgr2=0x7efe441043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 --2- 172.21.15.144:0/632060600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe441043f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe34009900 tx=0x7efe3402a410 comp rx=0 tx=0).stop 2024-09-05T07:50:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 -- 172.21.15.144:0/632060600 shutdown_connections 2024-09-05T07:50:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 --2- 172.21.15.144:0/632060600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe44109140 0x7efe44110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 --2- 172.21.15.144:0/632060600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 0x7efe44108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 --2- 172.21.15.144:0/632060600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe441043f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 -- 172.21.15.144:0/632060600 >> 172.21.15.144:0/632060600 conn(0x7efe440ffa50 msgr2=0x7efe44101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 -- 172.21.15.144:0/632060600 shutdown_connections 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.798+0000 7efe4ae00640 1 -- 172.21.15.144:0/632060600 wait complete. 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 Processor -- start 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 -- start start 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe4419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 0x7efe4419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe44109140 0x7efe4419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe441141b0 con 0x7efe44104010 2024-09-05T07:50:06.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe44114030 con 0x7efe44109140 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.799+0000 7efe4ae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe44114330 con 0x7efe441049c0 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe4419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe4419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53250/0 (socket says 172.21.15.144:53250) 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43e00640 1 -- 172.21.15.144:0/3862411214 learned_addr learned my addr 172.21.15.144:0/3862411214 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 0x7efe4419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe48e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe44109140 0x7efe4419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 -- 172.21.15.144:0/3862411214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe44109140 msgr2=0x7efe4419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe44109140 0x7efe4419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 -- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 msgr2=0x7efe4419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe4419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43400640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4419f640 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.800+0000 7efe43e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe44104010 0x7efe4419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe43400640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 0x7efe4419abd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe3000e9f0 tx=0x7efe3000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3000ccc0 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4419f930 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe30005020 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30004a00 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.801+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe441a7210 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.802+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe44062980 con 0x7efe441049c0 2024-09-05T07:50:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.805+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efe300051d0 con 0x7efe441049c0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe40c00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efe280a2c90 0x7efe280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7efe300cf170 con 0x7efe441049c0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe43e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efe280a2c90 0x7efe280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe40c00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] conn(0x7efe280ac4e0 0x7efe280ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe280aefb0 con 0x7efe280ac4e0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.806+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7efe300cf520 con 0x7efe441049c0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.807+0000 7efe48e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] conn(0x7efe280ac4e0 0x7efe280ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.807+0000 7efe43e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efe280a2c90 0x7efe280a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe340096c0 tx=0x7efe340046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.807+0000 7efe48e00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] conn(0x7efe280ac4e0 0x7efe280ae900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.808+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== osd.6 v2:172.21.15.144:6818/2321298943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe280aefb0 con 0x7efe280ac4e0 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.823+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 --> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe44062e00 con 0x7efe280ac4e0 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.823+0000 7efe40c00640 1 -- 172.21.15.144:0/3862411214 <== osd.6 v2:172.21.15.144:6818/2321298943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efe44062e00 con 0x7efe280ac4e0 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.823+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] conn(0x7efe280ac4e0 msgr2=0x7efe280ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.823+0000 7efe4ae00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] conn(0x7efe280ac4e0 0x7efe280ae900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efe280a2c90 msgr2=0x7efe280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efe280a2c90 0x7efe280a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe340096c0 tx=0x7efe340046c0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 msgr2=0x7efe4419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 --2- 172.21.15.144:0/3862411214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe441049c0 0x7efe4419abd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe3000e9f0 tx=0x7efe3000edf0 comp rx=0 tx=0).stop 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe48e00640 1 -- 172.21.15.144:0/3862411214 reap_dead start 2024-09-05T07:50:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 shutdown_connections 2024-09-05T07:50:06.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 >> 172.21.15.144:0/3862411214 conn(0x7efe440ffa50 msgr2=0x7efe44100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:06.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 shutdown_connections 2024-09-05T07:50:06.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:02.824+0000 7efe4ae00640 1 -- 172.21.15.144:0/3862411214 wait complete. 2024-09-05T07:50:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:50:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]': finished 2024-09-05T07:50:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-05T07:50:06.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:06 smithi175 ceph-mon[34585]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T07:50:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:50:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 4]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-05T07:50:06.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-05T07:50:06.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-05T07:50:06.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-05T07:50:06.939 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:06 smithi154 ceph-mon[34710]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T07:50:07.515 INFO:teuthology.orchestra.run.smithi144.stdout:193273528370 2024-09-05T07:50:07.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-05T07:50:07.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:07 smithi144 ceph-mon[29535]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T07:50:07.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:07 smithi175 ceph-mon[34585]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T07:50:07.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:07 smithi154 ceph-mon[34710]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T07:50:08.299 INFO:teuthology.orchestra.run.smithi144.stdout:330712481816 2024-09-05T07:50:08.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-05T07:50:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:08 smithi144 ceph-mon[29535]: pgmap v316: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-05T07:50:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:08 smithi175 ceph-mon[34585]: pgmap v316: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-05T07:50:08.840 INFO:teuthology.orchestra.run.smithi144.stdout:55834574923 2024-09-05T07:50:08.841 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-05T07:50:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:08 smithi154 ceph-mon[34710]: pgmap v316: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-05T07:50:09.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.793+0000 7f7b81e00640 1 -- 172.21.15.144:0/2664908241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c104010 msgr2=0x7f7b7c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.793+0000 7f7b81e00640 1 --2- 172.21.15.144:0/2664908241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c104010 0x7f7b7c1043f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009900 tx=0x7f7b6c02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 -- 172.21.15.144:0/2664908241 shutdown_connections 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 --2- 172.21.15.144:0/2664908241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b7c1049c0 0x7f7b7c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 --2- 172.21.15.144:0/2664908241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c109140 0x7f7b7c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 --2- 172.21.15.144:0/2664908241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c104010 0x7f7b7c1043f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 -- 172.21.15.144:0/2664908241 >> 172.21.15.144:0/2664908241 conn(0x7f7b7c0ffa50 msgr2=0x7f7b7c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 -- 172.21.15.144:0/2664908241 shutdown_connections 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.794+0000 7f7b81e00640 1 -- 172.21.15.144:0/2664908241 wait complete. 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.795+0000 7f7b81e00640 1 Processor -- start 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.795+0000 7f7b81e00640 1 -- start start 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c104010 0x7f7b7c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b7c1049c0 0x7f7b7c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 0x7f7b7c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c114170 con 0x7f7b7c109140 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c113ff0 con 0x7f7b7c1049c0 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b81e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c1142f0 con 0x7f7b7c104010 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 0x7f7b7c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c104010 0x7f7b7c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 0x7f7b7c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53294/0 (socket says 172.21.15.144:53294) 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 -- 172.21.15.144:0/1705506379 learned_addr learned my addr 172.21.15.144:0/1705506379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7a000640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b7c1049c0 0x7f7b7c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 -- 172.21.15.144:0/1705506379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c104010 msgr2=0x7f7b7c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c104010 0x7f7b7c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 -- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b7c1049c0 msgr2=0x7f7b7c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b7c1049c0 0x7f7b7c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.796+0000 7f7b7b400640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c19f5e0 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b7b400640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 0x7f7b7c19ef00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400eb10 tx=0x7f7b7400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74004b20 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c19f8d0 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b74004cc0 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74010700 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.797+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c1a71b0 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.798+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b7c062940 con 0x7f7b7c109140 2024-09-05T07:50:09.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.800+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7b74005020 con 0x7f7b7c109140 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.801+0000 7f7b80a00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b600a2c10 0x7f7b600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.801+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7b740cfe30 con 0x7f7b7c109140 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.801+0000 7f7b7aa00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b600a2c10 0x7f7b600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b80a00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] conn(0x7f7b600ac840 0x7f7b600aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b600af3b0 con 0x7f7b600ac840 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f7b740d01e0 con 0x7f7b7c109140 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b7a000640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] conn(0x7f7b600ac840 0x7f7b600aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b7aa00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b600a2c10 0x7f7b600a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009230 tx=0x7f7b6c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.802+0000 7f7b7a000640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] conn(0x7f7b600ac840 0x7f7b600aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:09.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.803+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== osd.7 v2:172.21.15.154:6816/1490453395 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b600af3b0 con 0x7f7b600ac840 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.818+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 --> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b7c062d40 con 0x7f7b600ac840 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.818+0000 7f7b80a00640 1 -- 172.21.15.144:0/1705506379 <== osd.7 v2:172.21.15.154:6816/1490453395 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7b7c062d40 con 0x7f7b600ac840 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] conn(0x7f7b600ac840 msgr2=0x7f7b600aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] conn(0x7f7b600ac840 0x7f7b600aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b600a2c10 msgr2=0x7f7b600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b600a2c10 0x7f7b600a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009230 tx=0x7f7b6c0058d0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 msgr2=0x7f7b7c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 --2- 172.21.15.144:0/1705506379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b7c109140 0x7f7b7c19ef00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400eb10 tx=0x7f7b7400c2d0 comp rx=0 tx=0).stop 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b7b400640 1 -- 172.21.15.144:0/1705506379 reap_dead start 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 shutdown_connections 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 >> 172.21.15.144:0/1705506379 conn(0x7f7b7c0ffa50 msgr2=0x7f7b7c100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:09.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 shutdown_connections 2024-09-05T07:50:09.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:05.819+0000 7f7b81e00640 1 -- 172.21.15.144:0/1705506379 wait complete. 2024-09-05T07:50:09.911 INFO:teuthology.orchestra.run.smithi144.stdout:107374182466 2024-09-05T07:50:09.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 -- 172.21.15.144:0/3744324658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 msgr2=0x7f26dc110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 --2- 172.21.15.144:0/3744324658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 0x7f26dc110840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009ca0 tx=0x7f26d402a950 comp rx=0 tx=0).stop 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 -- 172.21.15.144:0/3744324658 shutdown_connections 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 --2- 172.21.15.144:0/3744324658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc074e30 0x7f26dc10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 --2- 172.21.15.144:0/3744324658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 0x7f26dc110840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 --2- 172.21.15.144:0/3744324658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 -- 172.21.15.144:0/3744324658 >> 172.21.15.144:0/3744324658 conn(0x7f26dc0fd8b0 msgr2=0x7f26dc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 -- 172.21.15.144:0/3744324658 shutdown_connections 2024-09-05T07:50:10.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.205+0000 7f26e2600640 1 -- 172.21.15.144:0/3744324658 wait complete. 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 Processor -- start 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 -- start start 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc074e30 0x7f26dc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 0x7f26dc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1141c0 con 0x7f26dc10e450 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc114040 con 0x7f26dc074e30 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.206+0000 7f26e2600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc114340 con 0x7f26dc074510 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:45042/0 (socket says 172.21.15.144:45042) 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 -- 172.21.15.144:0/1902362084 learned_addr learned my addr 172.21.15.144:0/1902362084 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:10.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26dbe00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 0x7f26dc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26daa00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc074e30 0x7f26dc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 -- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc074e30 msgr2=0x7f26dc19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc074e30 0x7f26dc19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 -- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 msgr2=0x7f26dc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26dc10e450 0x7f26dc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.207+0000 7f26db400640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc19f5d0 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26db400640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc19a620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00e9f0 tx=0x7f26cc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00cd80 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26cc005500 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc010690 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc19f8c0 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.208+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc1a71a0 con 0x7f26dc074510 2024-09-05T07:50:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.209+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26dc0fff20 con 0x7f26dc074510 2024-09-05T07:50:10.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.211+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f26cc0046c0 con 0x7f26dc074510 2024-09-05T07:50:10.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.212+0000 7f26d3e00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26c00a2c90 0x7f26c00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:10.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f26cc0cfa00 con 0x7f26dc074510 2024-09-05T07:50:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26daa00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26c00a2c90 0x7f26c00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26d3e00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] conn(0x7f26c00ac8c0 0x7f26c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26cc005350 con 0x7f26c00ac8c0 2024-09-05T07:50:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f26cc0cfdb0 con 0x7f26dc074510 2024-09-05T07:50:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26dbe00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] conn(0x7f26c00ac8c0 0x7f26c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:10.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.213+0000 7f26daa00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26c00a2c90 0x7f26c00a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26dc10f700 tx=0x7f26c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:10.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.214+0000 7f26dbe00640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] conn(0x7f26c00ac8c0 0x7f26c00aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:10.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.215+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== osd.10 v2:172.21.15.154:6824/1235754603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26cc005350 con 0x7f26c00ac8c0 2024-09-05T07:50:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.230+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 --> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26dc075c50 con 0x7f26c00ac8c0 2024-09-05T07:50:10.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26d3e00640 1 -- 172.21.15.144:0/1902362084 <== osd.10 v2:172.21.15.154:6824/1235754603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f26dc075c50 con 0x7f26c00ac8c0 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] conn(0x7f26c00ac8c0 msgr2=0x7f26c00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] conn(0x7f26c00ac8c0 0x7f26c00aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26c00a2c90 msgr2=0x7f26c00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f26c00a2c90 0x7f26c00a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26dc10f700 tx=0x7f26c8005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 msgr2=0x7f26dc19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 --2- 172.21.15.144:0/1902362084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26dc074510 0x7f26dc19a620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00e9f0 tx=0x7f26cc00edf0 comp rx=0 tx=0).stop 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26dbe00640 1 -- 172.21.15.144:0/1902362084 reap_dead start 2024-09-05T07:50:10.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 shutdown_connections 2024-09-05T07:50:10.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 >> 172.21.15.144:0/1902362084 conn(0x7f26dc0fd8b0 msgr2=0x7f26dc0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:10.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.231+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 shutdown_connections 2024-09-05T07:50:10.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:10.232+0000 7f26e2600640 1 -- 172.21.15.144:0/1902362084 wait complete. 2024-09-05T07:50:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:158913790007 2024-09-05T07:50:10.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-05T07:50:10.783 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:10 smithi144 ceph-mon[29535]: pgmap v317: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:10 smithi175 ceph-mon[34585]: pgmap v317: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:10 smithi154 ceph-mon[34710]: pgmap v317: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:11.128 INFO:teuthology.orchestra.run.smithi144.stdout:214748364845 2024-09-05T07:50:11.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-05T07:50:11.606 INFO:teuthology.orchestra.run.smithi144.stdout:300647710750 2024-09-05T07:50:11.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-05T07:50:11.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:11 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:50:11.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:11 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:50:11.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:11 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:50:12.056 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:12.078 INFO:teuthology.orchestra.run.smithi144.stdout:279172874273 2024-09-05T07:50:12.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-05T07:50:12.185 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:12.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:12 smithi144 ceph-mon[29535]: pgmap v318: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:12.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:12 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:12 smithi175 ceph-mon[34585]: pgmap v318: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:12 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 -- 172.21.15.144:0/1574858347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4106f10 msgr2=0x7f3eb410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 --2- 172.21.15.144:0/1574858347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4106f10 0x7f3eb410ea90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009ca0 tx=0x7f3eac02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 -- 172.21.15.144:0/1574858347 shutdown_connections 2024-09-05T07:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 --2- 172.21.15.144:0/1574858347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 --2- 172.21.15.144:0/1574858347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4106f10 0x7f3eb410ea90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 --2- 172.21.15.144:0/1574858347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4101de0 0x7f3eb41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 -- 172.21.15.144:0/1574858347 >> 172.21.15.144:0/1574858347 conn(0x7f3eb40fd8c0 msgr2=0x7f3eb40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.824+0000 7f3ebb600640 1 -- 172.21.15.144:0/1574858347 shutdown_connections 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.825+0000 7f3ebb600640 1 -- 172.21.15.144:0/1574858347 wait complete. 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 Processor -- start 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 -- start start 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4101de0 0x7f3eb419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4106f10 0x7f3eb419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4111fc0 con 0x7f3eb4101de0 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4111e40 con 0x7f3eb4102790 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3ebb600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4112140 con 0x7f3eb4106f10 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3eabe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3eabe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:44650/0 (socket says 172.21.15.144:44650) 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.826+0000 7f3eabe00640 1 -- 172.21.15.144:0/3022014560 learned_addr learned my addr 172.21.15.144:0/3022014560 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eb9600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4106f10 0x7f3eb419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eb8c00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4101de0 0x7f3eb419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 -- 172.21.15.144:0/3022014560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4106f10 msgr2=0x7f3eb419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4106f10 0x7f3eb419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 -- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4101de0 msgr2=0x7f3eb419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4101de0 0x7f3eb419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 -- 172.21.15.144:0/3022014560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb419f590 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.827+0000 7f3eabe00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e9f0 tx=0x7f3e9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.828+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00cd80 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.828+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c010910 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.828+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c018990 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.828+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb419f880 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.828+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb41a7160 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.829+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb41021c0 con 0x7f3eb4102790 2024-09-05T07:50:12.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.831+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3e9c010ac0 con 0x7f3eb4102790 2024-09-05T07:50:12.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.833+0000 7f3eb2000640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 0x7f3e980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:12.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.833+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f3e9c0cf4d0 con 0x7f3eb4102790 2024-09-05T07:50:12.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.833+0000 7f3eb8c00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 0x7f3e980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:12.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.834+0000 7f3eb8c00640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 0x7f3e980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009bd0 tx=0x7f3ea4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:12.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:12.836+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e9c09bc10 con 0x7f3eb4102790 2024-09-05T07:50:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:12 smithi154 ceph-mon[34710]: pgmap v318: 97 pgs: 2 activating, 95 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:12 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.020+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3eb41a73c0 con 0x7f3eb4102790 2024-09-05T07:50:13.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.020+0000 7f3eb2000640 1 -- 172.21.15.144:0/3022014560 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3e9c09ff10 con 0x7f3eb4102790 2024-09-05T07:50:13.021 INFO:teuthology.orchestra.run.smithi144.stdout:137438953533 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 msgr2=0x7f3e980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 0x7f3e980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009bd0 tx=0x7f3ea4005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 msgr2=0x7f3eb419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e9f0 tx=0x7f3e9c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 shutdown_connections 2024-09-05T07:50:13.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f3e980a2c10 0x7f3e980a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4102790 0x7f3eb419ab20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eb4106f10 0x7f3eb419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 --2- 172.21.15.144:0/3022014560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eb4101de0 0x7f3eb419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 >> 172.21.15.144:0/3022014560 conn(0x7f3eb40fd8c0 msgr2=0x7f3eb40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 shutdown_connections 2024-09-05T07:50:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.023+0000 7f3ebb600640 1 -- 172.21.15.144:0/3022014560 wait complete. 2024-09-05T07:50:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 -- 172.21.15.144:0/2781624538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4106f10 msgr2=0x7fcee410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 --2- 172.21.15.144:0/2781624538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4106f10 0x7fcee410ea90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009ca0 tx=0x7fcedc02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 -- 172.21.15.144:0/2781624538 shutdown_connections 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 --2- 172.21.15.144:0/2781624538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4106f10 0x7fcee410ea90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 --2- 172.21.15.144:0/2781624538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4102790 0x7fcee41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 --2- 172.21.15.144:0/2781624538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee4101de0 0x7fcee41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 -- 172.21.15.144:0/2781624538 >> 172.21.15.144:0/2781624538 conn(0x7fcee40fd8c0 msgr2=0x7fcee40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 -- 172.21.15.144:0/2781624538 shutdown_connections 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.131+0000 7fcee9e00640 1 -- 172.21.15.144:0/2781624538 wait complete. 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 Processor -- start 2024-09-05T07:50:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 -- start start 2024-09-05T07:50:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4102790 0x7fcee41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee4106f10 0x7fcee419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4111fc0 con 0x7fcee4102790 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4111e40 con 0x7fcee4106f10 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.133+0000 7fcee9e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4112140 con 0x7fcee4101de0 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:56084/0 (socket says 172.21.15.144:56084) 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 -- 172.21.15.144:0/1990761610 learned_addr learned my addr 172.21.15.144:0/1990761610 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2000640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4102790 0x7fcee41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 -- 172.21.15.144:0/1990761610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee4106f10 msgr2=0x7fcee419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee4106f10 0x7fcee419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 -- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4102790 msgr2=0x7fcee41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4102790 0x7fcee41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 -- 172.21.15.144:0/1990761610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee419d350 con 0x7fcee4101de0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee2a00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fced400e9f0 tx=0x7fced400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.134+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced400cd80 con 0x7fcee4101de0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.135+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fced4010910 con 0x7fcee4101de0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.135+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4018990 con 0x7fcee4101de0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.135+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee419d640 con 0x7fcee4101de0 2024-09-05T07:50:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.135+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee41a4f20 con 0x7fcee4101de0 2024-09-05T07:50:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.136+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee41021c0 con 0x7fcee4101de0 2024-09-05T07:50:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.138+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fced4010ac0 con 0x7fcee4101de0 2024-09-05T07:50:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.139+0000 7fcee8a00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 0x7fcec80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.139+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fced40cf600 con 0x7fcee4101de0 2024-09-05T07:50:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.139+0000 7fcee2000640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 0x7fcec80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.140+0000 7fcee2000640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 0x7fcec80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fced00095f0 tx=0x7fced0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.143+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fced409c390 con 0x7fcee4101de0 2024-09-05T07:50:13.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.323+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcee41a51c0 con 0x7fcee4101de0 2024-09-05T07:50:13.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.323+0000 7fcee8a00640 1 -- 172.21.15.144:0/1990761610 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fced409bc90 con 0x7fcee4101de0 2024-09-05T07:50:13.324 INFO:teuthology.orchestra.run.smithi144.stdout:214748364846 2024-09-05T07:50:13.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 msgr2=0x7fcec80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 0x7fcec80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fced00095f0 tx=0x7fced0005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 msgr2=0x7fcee41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fced400e9f0 tx=0x7fced400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 shutdown_connections 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcec80a2c10 0x7fcec80a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee4106f10 0x7fcee419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee4102790 0x7fcee41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 --2- 172.21.15.144:0/1990761610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcee4101de0 0x7fcee41983a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:13.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 >> 172.21.15.144:0/1990761610 conn(0x7fcee40fd8c0 msgr2=0x7fcee40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:13.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 shutdown_connections 2024-09-05T07:50:13.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:13.326+0000 7fcee9e00640 1 -- 172.21.15.144:0/1990761610 wait complete. 2024-09-05T07:50:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:13.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:13 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3022014560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T07:50:13.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:13 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1990761610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T07:50:13.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:13 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3022014560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T07:50:13.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:13 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1990761610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T07:50:13.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:13 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3022014560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T07:50:13.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:13 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1990761610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T07:50:14.347 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364845 got 214748364846 for osd.7 2024-09-05T07:50:14.347 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:14.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:14 smithi144 ceph-mon[29535]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:14.698 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953531 got 137438953533 for osd.4 2024-09-05T07:50:14.698 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:14 smithi175 ceph-mon[34585]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:14.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:14 smithi154 ceph-mon[34710]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:14.974 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:14.975 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:14.976 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:14.983 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:14.983 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:14.987 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.488+0000 7f355e600640 1 -- 172.21.15.144:0/3537831101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 msgr2=0x7f3558110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.488+0000 7f355e600640 1 --2- 172.21.15.144:0/3537831101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f3558110ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3550009ca0 tx=0x7f355002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 -- 172.21.15.144:0/3537831101 shutdown_connections 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 --2- 172.21.15.144:0/3537831101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35581047e0 0x7f3558108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 --2- 172.21.15.144:0/3537831101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f3558110ae0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 --2- 172.21.15.144:0/3537831101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3558103e30 0x7f3558104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 -- 172.21.15.144:0/3537831101 >> 172.21.15.144:0/3537831101 conn(0x7f35580ff910 msgr2=0x7f3558101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 -- 172.21.15.144:0/3537831101 shutdown_connections 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.489+0000 7f355e600640 1 -- 172.21.15.144:0/3537831101 wait complete. 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 Processor -- start 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 -- start start 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 0x7f355819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35581047e0 0x7f355819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3558114010 con 0x7f3558108f60 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3558113e90 con 0x7f3558103e30 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355e600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3558114190 con 0x7f35581047e0 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 0x7f355819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54752/0 (socket says 172.21.15.144:54752) 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f355dc00640 1 -- 172.21.15.144:0/878497353 learned_addr learned my addr 172.21.15.144:0/878497353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.490+0000 7f3557e00640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35581047e0 0x7f355819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 -- 172.21.15.144:0/878497353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35581047e0 msgr2=0x7f355819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35581047e0 0x7f355819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 -- 172.21.15.144:0/878497353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 msgr2=0x7f355819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 0x7f355819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 -- 172.21.15.144:0/878497353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355819f3e0 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355d200640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 0x7f355819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355dc00640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3550005e30 tx=0x7f3550003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550031650 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35500317f0 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355819f670 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.491+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355002f9d0 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.492+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35581a6fb0 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.493+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3558105310 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.494+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f355002fbf0 con 0x7f3558108f60 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.495+0000 7f3555600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 0x7f35400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.496+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f35500f0430 con 0x7f3558108f60 2024-09-05T07:50:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.496+0000 7f355d200640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 0x7f35400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.496+0000 7f355d200640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 0x7f35400a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f354c009fc0 tx=0x7f354c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.500+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35500bd2d0 con 0x7f3558108f60 2024-09-05T07:50:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:15.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.695+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3558104210 con 0x7f3558108f60 2024-09-05T07:50:15.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.695+0000 7f3555600640 1 -- 172.21.15.144:0/878497353 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3558104210 con 0x7f3558108f60 2024-09-05T07:50:15.696 INFO:teuthology.orchestra.run.smithi144.stdout:330712481818 2024-09-05T07:50:15.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.697+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 msgr2=0x7f35400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.697+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 0x7f35400a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f354c009fc0 tx=0x7f354c005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:15.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.697+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 msgr2=0x7f355819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.697+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3550005e30 tx=0x7f3550003d00 comp rx=0 tx=0).stop 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 shutdown_connections 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f35400a2c10 0x7f35400a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3558108f60 0x7f355819ed00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35581047e0 0x7f355819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 --2- 172.21.15.144:0/878497353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3558103e30 0x7f355819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 >> 172.21.15.144:0/878497353 conn(0x7f35580ff910 msgr2=0x7f3558100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 shutdown_connections 2024-09-05T07:50:15.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.698+0000 7f355e600640 1 -- 172.21.15.144:0/878497353 wait complete. 2024-09-05T07:50:15.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 -- 172.21.15.144:0/1212837383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 msgr2=0x7f693c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 --2- 172.21.15.144:0/1212837383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c110ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6934009ca0 tx=0x7f693402a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 -- 172.21.15.144:0/1212837383 shutdown_connections 2024-09-05T07:50:15.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 --2- 172.21.15.144:0/1212837383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1047e0 0x7f693c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 --2- 172.21.15.144:0/1212837383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c110ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 --2- 172.21.15.144:0/1212837383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c103e30 0x7f693c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 -- 172.21.15.144:0/1212837383 >> 172.21.15.144:0/1212837383 conn(0x7f693c0ff8d0 msgr2=0x7f693c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 -- 172.21.15.144:0/1212837383 shutdown_connections 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.749+0000 7f6942600640 1 -- 172.21.15.144:0/1212837383 wait complete. 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.750+0000 7f6942600640 1 Processor -- start 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.750+0000 7f6942600640 1 -- start start 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c103e30 0x7f693c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 0x7f693c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f693c113fc0 con 0x7f693c108f60 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f693c113e40 con 0x7f693c103e30 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6942600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f693c114140 con 0x7f693c1047e0 2024-09-05T07:50:15.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54762/0 (socket says 172.21.15.144:54762) 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 -- 172.21.15.144:0/2615240135 learned_addr learned my addr 172.21.15.144:0/2615240135 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941200640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c103e30 0x7f693c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f693be00640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 0x7f693c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 -- 172.21.15.144:0/2615240135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 msgr2=0x7f693c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 0x7f693c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 -- 172.21.15.144:0/2615240135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c103e30 msgr2=0x7f693c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c103e30 0x7f693c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.751+0000 7f6941c00640 1 -- 172.21.15.144:0/2615240135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c19f390 con 0x7f693c108f60 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f693be00640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 0x7f693c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6941c00640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6934031a20 tx=0x7f6934031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934003b70 con 0x7f693c108f60 2024-09-05T07:50:15.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6934003d10 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c19f620 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693402fc40 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.752+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c1a6f60 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.753+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693c104210 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.755+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6934004050 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.756+0000 7f6939600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 0x7f69240a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.756+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f69340f0220 con 0x7f693c108f60 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.757+0000 7f6941200640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 0x7f69240a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.757+0000 7f6941200640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 0x7f69240a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6930009bd0 tx=0x7f6930005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:15.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.760+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69340bd270 con 0x7f693c108f60 2024-09-05T07:50:15.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.949+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f693c10c1a0 con 0x7f693c108f60 2024-09-05T07:50:15.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.950+0000 7f6939600640 1 -- 172.21.15.144:0/2615240135 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f69340bcb70 con 0x7f693c108f60 2024-09-05T07:50:15.951 INFO:teuthology.orchestra.run.smithi144.stdout:244813135914 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 msgr2=0x7f69240a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 0x7f69240a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6930009bd0 tx=0x7f6930005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 msgr2=0x7f693c19ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6934031a20 tx=0x7f6934031a50 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 shutdown_connections 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f69240a2c90 0x7f69240a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c108f60 0x7f693c19ecb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c1047e0 0x7f693c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 --2- 172.21.15.144:0/2615240135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c103e30 0x7f693c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 >> 172.21.15.144:0/2615240135 conn(0x7f693c0ff8d0 msgr2=0x7f693c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:15.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 shutdown_connections 2024-09-05T07:50:15.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:15.952+0000 7f6942600640 1 -- 172.21.15.144:0/2615240135 wait complete. 2024-09-05T07:50:16.744 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:16 smithi144 ceph-mon[29535]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:16.744 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:16 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/878497353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T07:50:16.744 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:16 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2615240135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T07:50:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:16 smithi175 ceph-mon[34585]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:16 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/878497353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T07:50:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:16 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2615240135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T07:50:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:16 smithi154 ceph-mon[34710]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T07:50:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:16 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/878497353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T07:50:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:16 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2615240135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T07:50:17.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 -- 172.21.15.144:0/3658444977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 msgr2=0x7f60541043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:17.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 --2- 172.21.15.144:0/3658444977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f60541043d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6044009900 tx=0x7f604402a410 comp rx=0 tx=0).stop 2024-09-05T07:50:17.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 -- 172.21.15.144:0/3658444977 shutdown_connections 2024-09-05T07:50:17.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 --2- 172.21.15.144:0/3658444977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 0x7f60541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 --2- 172.21.15.144:0/3658444977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 0x7f6054110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 --2- 172.21.15.144:0/3658444977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f60541043d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.146+0000 7f6058e00640 1 -- 172.21.15.144:0/3658444977 >> 172.21.15.144:0/3658444977 conn(0x7f60540ffa90 msgr2=0x7f6054101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.147+0000 7f6058e00640 1 -- 172.21.15.144:0/3658444977 shutdown_connections 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.147+0000 7f6058e00640 1 -- 172.21.15.144:0/3658444977 wait complete. 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.147+0000 7f6058e00640 1 Processor -- start 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 -- start start 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 0x7f605419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 0x7f605419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6054114150 con 0x7f6054103ff0 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6054113fd0 con 0x7f60541049a0 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6058e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60541142d0 con 0x7f6054109120 2024-09-05T07:50:17.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6051e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6051e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54788/0 (socket says 172.21.15.144:54788) 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6051e00640 1 -- 172.21.15.144:0/2196516508 learned_addr learned my addr 172.21.15.144:0/2196516508 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6051400640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 0x7f605419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.148+0000 7f6052800640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 0x7f605419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 -- 172.21.15.144:0/2196516508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 msgr2=0x7f605419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 0x7f605419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 -- 172.21.15.144:0/2196516508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 msgr2=0x7f605419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 0x7f605419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 -- 172.21.15.144:0/2196516508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605419f5e0 con 0x7f6054103ff0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6051e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6044006010 tx=0x7f60440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604403f030 con 0x7f6054103ff0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605419f870 con 0x7f6054103ff0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6044003ce0 con 0x7f6054103ff0 2024-09-05T07:50:17.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044035070 con 0x7f6054103ff0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.149+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60541a71b0 con 0x7f6054103ff0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.150+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60541043d0 con 0x7f6054103ff0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.154+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6044042030 con 0x7f6054103ff0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.155+0000 7f604aa00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 0x7f60380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.155+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f60440ef280 con 0x7f6054103ff0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.155+0000 7f6051400640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 0x7f60380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.156+0000 7f6051400640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 0x7f60380a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60540ffeb0 tx=0x7f604000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:17.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.163+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60440bba80 con 0x7f6054103ff0 2024-09-05T07:50:17.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.351+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f605410c300 con 0x7f6054103ff0 2024-09-05T07:50:17.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.351+0000 7f604aa00640 1 -- 172.21.15.144:0/2196516508 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f60440bfd80 con 0x7f6054103ff0 2024-09-05T07:50:17.352 INFO:teuthology.orchestra.run.smithi144.stdout:158913790011 2024-09-05T07:50:17.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 msgr2=0x7f60380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:17.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 0x7f60380a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60540ffeb0 tx=0x7f604000b410 comp rx=0 tx=0).stop 2024-09-05T07:50:17.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 msgr2=0x7f605419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:17.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6044006010 tx=0x7f60440042f0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 shutdown_connections 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60380a2c90 0x7f60380a5150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60541049a0 0x7f605419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6054109120 0x7f605419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 --2- 172.21.15.144:0/2196516508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6054103ff0 0x7f605419a630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.353+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 >> 172.21.15.144:0/2196516508 conn(0x7f60540ffa90 msgr2=0x7f6054100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.354+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 shutdown_connections 2024-09-05T07:50:17.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.354+0000 7f6058e00640 1 -- 172.21.15.144:0/2196516508 wait complete. 2024-09-05T07:50:17.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/96601672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T07:50:17.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:17 smithi144 ceph-mon[29535]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 1 objects/s recovering 2024-09-05T07:50:17.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:17 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2196516508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T07:50:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/96601672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T07:50:17.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:17 smithi175 ceph-mon[34585]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 1 objects/s recovering 2024-09-05T07:50:17.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:17 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2196516508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T07:50:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/96601672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T07:50:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:17 smithi154 ceph-mon[34710]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 1 objects/s recovering 2024-09-05T07:50:17.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:17 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2196516508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T07:50:18.369 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790007 got 158913790011 for osd.5 2024-09-05T07:50:18.370 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:18.521 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:18.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135911 got 244813135914 for osd.8 2024-09-05T07:50:18.668 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:19.029 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481816 got 330712481818 for osd.11 2024-09-05T07:50:19.029 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 -- 172.21.15.144:0/4125560361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c106f10 msgr2=0x7fec5c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 --2- 172.21.15.144:0/4125560361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c106f10 0x7fec5c10ea90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ca0 tx=0x7fec5402a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 -- 172.21.15.144:0/4125560361 shutdown_connections 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 --2- 172.21.15.144:0/4125560361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c106f10 0x7fec5c10ea90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 --2- 172.21.15.144:0/4125560361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c102790 0x7fec5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 --2- 172.21.15.144:0/4125560361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c101de0 0x7fec5c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 -- 172.21.15.144:0/4125560361 >> 172.21.15.144:0/4125560361 conn(0x7fec5c0fd8c0 msgr2=0x7fec5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 -- 172.21.15.144:0/4125560361 shutdown_connections 2024-09-05T07:50:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.024+0000 7fec62400640 1 -- 172.21.15.144:0/4125560361 wait complete. 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.025+0000 7fec62400640 1 Processor -- start 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.025+0000 7fec62400640 1 -- start start 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.025+0000 7fec62400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.025+0000 7fec62400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c102790 0x7fec5c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.025+0000 7fec62400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 0x7fec5c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec62400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c111fc0 con 0x7fec5c101de0 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec62400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c111e40 con 0x7fec5c102790 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec62400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c112140 con 0x7fec5c106f10 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54776/0 (socket says 172.21.15.144:54776) 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 -- 172.21.15.144:0/96601672 learned_addr learned my addr 172.21.15.144:0/96601672 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5be00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 0x7fec5c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec52a00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c102790 0x7fec5c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 -- 172.21.15.144:0/96601672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 msgr2=0x7fec5c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 0x7fec5c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 -- 172.21.15.144:0/96601672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c102790 msgr2=0x7fec5c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c102790 0x7fec5c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 -- 172.21.15.144:0/96601672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c19d400 con 0x7fec5c101de0 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5be00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 0x7fec5c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:19.554 INFO:teuthology.orchestra.run.smithi144.stdout:107374182468 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.026+0000 7fec5b400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e9f0 tx=0x7fec4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.027+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00cd80 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.027+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec4c010910 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.027+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c19d6f0 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.027+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c018990 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.027+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c1a4fd0 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.028+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c1021c0 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.030+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fec4c010ac0 con 0x7fec5c101de0 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.031+0000 7fec58c00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.032+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fec4c0cf690 con 0x7fec5c101de0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.032+0000 7fec52a00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.033+0000 7fec52a00640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 0x7fec400a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec5c1087d0 tx=0x7fec44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.036+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec4c09c420 con 0x7fec5c101de0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.233+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fec5c1a51d0 con 0x7fec5c101de0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.234+0000 7fec58c00640 1 -- 172.21.15.144:0/96601672 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fec4c09bd20 con 0x7fec5c101de0 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 msgr2=0x7fec400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 0x7fec400a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec5c1087d0 tx=0x7fec44005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 msgr2=0x7fec5c198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e9f0 tx=0x7fec4c00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 shutdown_connections 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec5c102790 0x7fec5c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5c106f10 0x7fec5c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 --2- 172.21.15.144:0/96601672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c101de0 0x7fec5c198450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 >> 172.21.15.144:0/96601672 conn(0x7fec5c0fd8c0 msgr2=0x7fec5c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 shutdown_connections 2024-09-05T07:50:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:17.236+0000 7fec62400640 1 -- 172.21.15.144:0/96601672 wait complete. 2024-09-05T07:50:20.505 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:20 smithi144 ceph-mon[29535]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T07:50:20.505 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:20 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/8379539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T07:50:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:20 smithi175 ceph-mon[34585]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T07:50:20.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:20 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/8379539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T07:50:20.641 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:20 smithi154 ceph-mon[34710]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T07:50:20.641 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:20 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/8379539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T07:50:21.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182466 got 107374182468 for osd.3 2024-09-05T07:50:21.211 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:21.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 -- 172.21.15.144:0/1351685045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff74074f40 msgr2=0x7eff7410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 --2- 172.21.15.144:0/1351685045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff74074f40 0x7eff7410de80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7eff60009900 tx=0x7eff6002a480 comp rx=0 tx=0).stop 2024-09-05T07:50:21.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 -- 172.21.15.144:0/1351685045 shutdown_connections 2024-09-05T07:50:21.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 --2- 172.21.15.144:0/1351685045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7410e3c0 0x7eff74110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 --2- 172.21.15.144:0/1351685045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff74074f40 0x7eff7410de80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 --2- 172.21.15.144:0/1351685045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff74074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.410+0000 7eff78e00640 1 -- 172.21.15.144:0/1351685045 >> 172.21.15.144:0/1351685045 conn(0x7eff740fd8c0 msgr2=0x7eff740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.411+0000 7eff78e00640 1 -- 172.21.15.144:0/1351685045 shutdown_connections 2024-09-05T07:50:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.411+0000 7eff78e00640 1 -- 172.21.15.144:0/1351685045 wait complete. 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 Processor -- start 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 -- start start 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74074f40 0x7eff7419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7410e3c0 0x7eff7419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff74114190 con 0x7eff7410e3c0 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff74114010 con 0x7eff74074620 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff78e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff74114310 con 0x7eff74074f40 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff71e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff71e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:44800/0 (socket says 172.21.15.144:44800) 2024-09-05T07:50:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.412+0000 7eff71e00640 1 -- 172.21.15.144:0/2481216312 learned_addr learned my addr 172.21.15.144:0/2481216312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff72800640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7410e3c0 0x7eff7419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71400640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74074f40 0x7eff7419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 -- 172.21.15.144:0/2481216312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74074f40 msgr2=0x7eff7419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74074f40 0x7eff7419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 -- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7410e3c0 msgr2=0x7eff7419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7410e3c0 0x7eff7419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 -- 172.21.15.144:0/2481216312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7419f6a0 con 0x7eff74074620 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff71e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff6400e9f0 tx=0x7eff6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6400cd80 con 0x7eff74074620 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff64010910 con 0x7eff74074620 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7419f990 con 0x7eff74074620 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.413+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64018990 con 0x7eff74074620 2024-09-05T07:50:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.414+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741a7270 con 0x7eff74074620 2024-09-05T07:50:21.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.415+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff74074a00 con 0x7eff74074620 2024-09-05T07:50:21.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.416+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7eff64010ac0 con 0x7eff74074620 2024-09-05T07:50:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.418+0000 7eff6aa00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 0x7eff580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.418+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7eff640cf550 con 0x7eff74074620 2024-09-05T07:50:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.418+0000 7eff71400640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 0x7eff580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.418+0000 7eff71400640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 0x7eff580a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff60000c00 tx=0x7eff60005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.421+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff6409bc90 con 0x7eff74074620 2024-09-05T07:50:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.786+0000 7fa555c00640 1 -- 172.21.15.144:0/322582983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501019c0 msgr2=0x7fa550101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.786+0000 7fa555c00640 1 --2- 172.21.15.144:0/322582983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501019c0 0x7fa550101e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009930 tx=0x7fa53c02a420 comp rx=0 tx=0).stop 2024-09-05T07:50:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.786+0000 7fa555c00640 1 -- 172.21.15.144:0/322582983 shutdown_connections 2024-09-05T07:50:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 --2- 172.21.15.144:0/322582983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa550102360 0x7fa55010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 --2- 172.21.15.144:0/322582983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501019c0 0x7fa550101e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 --2- 172.21.15.144:0/322582983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5501079c0 0x7fa550107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 -- 172.21.15.144:0/322582983 >> 172.21.15.144:0/322582983 conn(0x7fa5500fd740 msgr2=0x7fa5500ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 -- 172.21.15.144:0/322582983 shutdown_connections 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.787+0000 7fa555c00640 1 -- 172.21.15.144:0/322582983 wait complete. 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 Processor -- start 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 -- start start 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550102360 0x7fa55019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 0x7fa55019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa550111e10 con 0x7fa5501079c0 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa550111c90 con 0x7fa550102360 2024-09-05T07:50:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa550111f90 con 0x7fa5501019c0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 0x7fa55019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa54fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa54f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550102360 0x7fa55019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa54fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:56200/0 (socket says 172.21.15.144:56200) 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa54fe00640 1 -- 172.21.15.144:0/8379539 learned_addr learned my addr 172.21.15.144:0/8379539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.788+0000 7fa555200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 0x7fa55019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54812/0 (socket says 172.21.15.144:54812) 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 -- 172.21.15.144:0/8379539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550102360 msgr2=0x7fa55019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550102360 0x7fa55019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 -- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 msgr2=0x7fa55019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 0x7fa55019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 -- 172.21.15.144:0/8379539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55019f470 con 0x7fa5501019c0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54fe00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9f0 tx=0x7fa54000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:21.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000cd80 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa540010910 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55019f760 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.789+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540018990 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.790+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a7040 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.791+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550101e20 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.792+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa540010ac0 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.794+0000 7fa54cc00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.794+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa5400cf410 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.794+0000 7fa54f400640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.795+0000 7fa54f400640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 0x7fa5340a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa53c006010 tx=0x7fa53c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:19.798+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa54009bb50 con 0x7fa5501019c0 2024-09-05T07:50:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.049+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa5501a7210 con 0x7fa5501019c0 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.050+0000 7fa54cc00640 1 -- 172.21.15.144:0/8379539 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa54009fe50 con 0x7fa5501019c0 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stdout:193273528374 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 msgr2=0x7fa5340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 0x7fa5340a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa53c006010 tx=0x7fa53c000bc0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 msgr2=0x7fa55019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9f0 tx=0x7fa54000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 shutdown_connections 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa5340a2c90 0x7fa5340a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550102360 0x7fa55019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5501079c0 0x7fa55019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 --2- 172.21.15.144:0/8379539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5501019c0 0x7fa55019a4c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 >> 172.21.15.144:0/8379539 conn(0x7fa5500fd740 msgr2=0x7fa55010d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 shutdown_connections 2024-09-05T07:50:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:20.053+0000 7fa555c00640 1 -- 172.21.15.144:0/8379539 wait complete. 2024-09-05T07:50:21.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.602+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7eff7419ba50 con 0x7eff74074620 2024-09-05T07:50:21.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.603+0000 7eff6aa00640 1 -- 172.21.15.144:0/2481216312 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7eff6409ff90 con 0x7eff74074620 2024-09-05T07:50:21.604 INFO:teuthology.orchestra.run.smithi144.stdout:300647710752 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 msgr2=0x7eff580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 0x7eff580a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff60000c00 tx=0x7eff60005b50 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 msgr2=0x7eff7419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff6400e9f0 tx=0x7eff6400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 shutdown_connections 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff580a2c10 0x7eff580a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7410e3c0 0x7eff7419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74074f40 0x7eff7419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 --2- 172.21.15.144:0/2481216312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff74074620 0x7eff7419a6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 >> 172.21.15.144:0/2481216312 conn(0x7eff740fd8c0 msgr2=0x7eff740fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:21.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 shutdown_connections 2024-09-05T07:50:21.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:21.605+0000 7eff78e00640 1 -- 172.21.15.144:0/2481216312 wait complete. 2024-09-05T07:50:22.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.229+0000 7f38e8800640 1 -- 172.21.15.144:0/1120643434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 msgr2=0x7f38e0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.229+0000 7f38e8800640 1 --2- 172.21.15.144:0/1120643434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e0110ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009ca0 tx=0x7f38dc02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 -- 172.21.15.144:0/1120643434 shutdown_connections 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 --2- 172.21.15.144:0/1120643434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e01049a0 0x7f38e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 --2- 172.21.15.144:0/1120643434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e0110ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 --2- 172.21.15.144:0/1120643434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e0103ff0 0x7f38e01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 -- 172.21.15.144:0/1120643434 >> 172.21.15.144:0/1120643434 conn(0x7f38e00ffa90 msgr2=0x7f38e0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 -- 172.21.15.144:0/1120643434 shutdown_connections 2024-09-05T07:50:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.230+0000 7f38e8800640 1 -- 172.21.15.144:0/1120643434 wait complete. 2024-09-05T07:50:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.231+0000 7f38e8800640 1 Processor -- start 2024-09-05T07:50:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.231+0000 7f38e8800640 1 -- start start 2024-09-05T07:50:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.231+0000 7f38e8800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e0103ff0 0x7f38e019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.231+0000 7f38e8800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.231+0000 7f38e8800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e8800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01141a0 con 0x7f38e0109120 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e8800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0114020 con 0x7f38e0103ff0 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e8800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0114320 con 0x7f38e01049a0 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54852/0 (socket says 172.21.15.144:54852) 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e6800640 1 -- 172.21.15.144:0/2652769038 learned_addr learned my addr 172.21.15.144:0/2652769038 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:56246/0 (socket says 172.21.15.144:56246) 2024-09-05T07:50:22.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5e00640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e0103ff0 0x7f38e019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 -- 172.21.15.144:0/2652769038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e0103ff0 msgr2=0x7f38e019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e0103ff0 0x7f38e019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 -- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 msgr2=0x7f38e019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.232+0000 7f38e5400640 1 -- 172.21.15.144:0/2652769038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e019f5b0 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38e5400640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e9f0 tx=0x7f38d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ccc0 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e019f8a0 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38d0010910 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0018960 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.233+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01a7180 con 0x7f38e01049a0 2024-09-05T07:50:22.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.234+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e01043d0 con 0x7f38e01049a0 2024-09-05T07:50:22.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.237+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f38d0010ac0 con 0x7f38e01049a0 2024-09-05T07:50:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.238+0000 7f38daa00640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 0x7f38c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.238+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f38d00cf8e0 con 0x7f38e01049a0 2024-09-05T07:50:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.238+0000 7f38e5e00640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 0x7f38c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.239+0000 7f38e5e00640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 0x7f38c80a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009bd0 tx=0x7f38d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:22.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.239+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38d009c020 con 0x7f38e01049a0 2024-09-05T07:50:22.393 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:22 smithi144 ceph-mon[29535]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:22.393 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:22 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2481216312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T07:50:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.427+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f38e01a74b0 con 0x7f38e01049a0 2024-09-05T07:50:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.428+0000 7f38daa00640 1 -- 172.21.15.144:0/2652769038 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38d00a0320 con 0x7f38e01049a0 2024-09-05T07:50:22.429 INFO:teuthology.orchestra.run.smithi144.stdout:55834574927 2024-09-05T07:50:22.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 msgr2=0x7f38c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 0x7f38c80a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009bd0 tx=0x7f38d4005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 msgr2=0x7f38e019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e9f0 tx=0x7f38d000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 shutdown_connections 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f38c80a2c10 0x7f38c80a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0109120 0x7f38e019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e01049a0 0x7f38e019ab40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 --2- 172.21.15.144:0/2652769038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38e0103ff0 0x7f38e019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 >> 172.21.15.144:0/2652769038 conn(0x7f38e00ffa90 msgr2=0x7f38e0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:22.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 shutdown_connections 2024-09-05T07:50:22.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.430+0000 7f38e8800640 1 -- 172.21.15.144:0/2652769038 wait complete. 2024-09-05T07:50:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:22 smithi175 ceph-mon[34585]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:22.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:22 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2481216312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T07:50:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:22 smithi154 ceph-mon[34710]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:22.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:22 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2481216312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T07:50:22.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 -- 172.21.15.144:0/941546148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e41027a0 msgr2=0x7f00e41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 --2- 172.21.15.144:0/941546148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e41027a0 0x7f00e41067f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009900 tx=0x7f00d002a410 comp rx=0 tx=0).stop 2024-09-05T07:50:22.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 -- 172.21.15.144:0/941546148 shutdown_connections 2024-09-05T07:50:22.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 --2- 172.21.15.144:0/941546148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e4106f20 0x7f00e410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 --2- 172.21.15.144:0/941546148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e41027a0 0x7f00e41067f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 --2- 172.21.15.144:0/941546148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 0x7f00e41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 -- 172.21.15.144:0/941546148 >> 172.21.15.144:0/941546148 conn(0x7f00e40fd8b0 msgr2=0x7f00e40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 -- 172.21.15.144:0/941546148 shutdown_connections 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.608+0000 7f00eac00640 1 -- 172.21.15.144:0/941546148 wait complete. 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.609+0000 7f00eac00640 1 Processor -- start 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.609+0000 7f00eac00640 1 -- start start 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 0x7f00e419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e41027a0 0x7f00e419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4111fd0 con 0x7f00e4106f20 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4111e50 con 0x7f00e41027a0 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00eac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4112150 con 0x7f00e4101df0 2024-09-05T07:50:22.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54864/0 (socket says 172.21.15.144:54864) 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 -- 172.21.15.144:0/2548961317 learned_addr learned my addr 172.21.15.144:0/2548961317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e3e00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 0x7f00e419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e3400640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e41027a0 0x7f00e419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 -- 172.21.15.144:0/2548961317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 msgr2=0x7f00e419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 0x7f00e419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 -- 172.21.15.144:0/2548961317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e41027a0 msgr2=0x7f00e419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e41027a0 0x7f00e419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.610+0000 7f00e8c00640 1 -- 172.21.15.144:0/2548961317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e419f600 con 0x7f00e4106f20 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00e8c00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009fd0 tx=0x7f00dc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc017070 con 0x7f00e4106f20 2024-09-05T07:50:22.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00dc003e50 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e419f8f0 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0106c0 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.611+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e41a71d0 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.612+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e41021d0 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.614+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f00dc003970 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.615+0000 7f00e0c00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.616+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f00dc0cef00 con 0x7f00e4106f20 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.616+0000 7f00e3e00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.616+0000 7f00e3e00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 0x7f00c80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00d400bbe0 tx=0x7f00d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:22.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.620+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00dc09b640 con 0x7f00e4106f20 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:34359738452 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.802+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f00e41a73a0 con 0x7f00e4106f20 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.802+0000 7f00e0c00640 1 -- 172.21.15.144:0/2548961317 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00dc097020 con 0x7f00e4106f20 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 msgr2=0x7f00c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 0x7f00c80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00d400bbe0 tx=0x7f00d400b390 comp rx=0 tx=0).stop 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 msgr2=0x7f00e419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:22.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009fd0 tx=0x7f00dc00b260 comp rx=0 tx=0).stop 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 shutdown_connections 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f00c80a2c10 0x7f00c80a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e41027a0 0x7f00e419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e4106f20 0x7f00e419ef20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.804+0000 7f00eac00640 1 --2- 172.21.15.144:0/2548961317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4101df0 0x7f00e419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.805+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 >> 172.21.15.144:0/2548961317 conn(0x7f00e40fd8b0 msgr2=0x7f00e40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.805+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 shutdown_connections 2024-09-05T07:50:22.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:22.805+0000 7f00eac00640 1 -- 172.21.15.144:0/2548961317 wait complete. 2024-09-05T07:50:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 -- 172.21.15.144:0/3570567958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c102b90 msgr2=0x7f085c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 --2- 172.21.15.144:0/3570567958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c102b90 0x7f085c102f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0850009900 tx=0x7f085002a480 comp rx=0 tx=0).stop 2024-09-05T07:50:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 -- 172.21.15.144:0/3570567958 shutdown_connections 2024-09-05T07:50:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 --2- 172.21.15.144:0/3570567958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 --2- 172.21.15.144:0/3570567958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c10bfc0 0x7f085c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 --2- 172.21.15.144:0/3570567958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c102b90 0x7f085c102f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 -- 172.21.15.144:0/3570567958 >> 172.21.15.144:0/3570567958 conn(0x7f085c0fc610 msgr2=0x7f085c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 -- 172.21.15.144:0/3570567958 shutdown_connections 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.383+0000 7f0862600640 1 -- 172.21.15.144:0/3570567958 wait complete. 2024-09-05T07:50:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.384+0000 7f0862600640 1 Processor -- start 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.384+0000 7f0862600640 1 -- start start 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 0x7f085c19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f085c111e10 con 0x7f085c10bfc0 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f085c111c90 con 0x7f085c1034b0 2024-09-05T07:50:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0862600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f085c111f90 con 0x7f085c102b90 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0861200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0861200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:33574/0 (socket says 172.21.15.144:33574) 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.385+0000 7f0861200640 1 -- 172.21.15.144:0/4273002913 learned_addr learned my addr 172.21.15.144:0/4273002913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f0861c00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 0x7f085c19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 -- 172.21.15.144:0/4273002913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 msgr2=0x7f085c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 -- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 msgr2=0x7f085c19ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 0x7f085c19ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f085be00640 1 -- 172.21.15.144:0/4273002913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c19f500 con 0x7f085c1034b0 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f0861c00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 0x7f085c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.386+0000 7f0861200640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f085be00640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c19aa90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f084800d680 tx=0x7f084800db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848017070 con 0x7f085c1034b0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08480097c0 con 0x7f085c1034b0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c19f7f0 con 0x7f085c1034b0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c1a70d0 con 0x7f085c1034b0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.387+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848004c60 con 0x7f085c1034b0 2024-09-05T07:50:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.389+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085c102f70 con 0x7f085c1034b0 2024-09-05T07:50:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.391+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0848005220 con 0x7f085c1034b0 2024-09-05T07:50:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.393+0000 7f0859600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 0x7f08440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.393+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f08480cea40 con 0x7f085c1034b0 2024-09-05T07:50:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.393+0000 7f0861200640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 0x7f08440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.394+0000 7f0861200640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 0x7f08440a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08500096c0 tx=0x7f08500046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.397+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f084809b830 con 0x7f085c1034b0 2024-09-05T07:50:23.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:23 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2652769038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T07:50:23.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:23 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2548961317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T07:50:23.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.582+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f085c1a7300 con 0x7f085c1034b0 2024-09-05T07:50:23.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.583+0000 7f0859600640 1 -- 172.21.15.144:0/4273002913 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f084809b130 con 0x7f085c1034b0 2024-09-05T07:50:23.584 INFO:teuthology.orchestra.run.smithi144.stdout:279172874277 2024-09-05T07:50:23.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 msgr2=0x7f08440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 0x7f08440a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08500096c0 tx=0x7f08500046c0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 msgr2=0x7f085c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c19aa90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f084800d680 tx=0x7f084800db40 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 shutdown_connections 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f08440a2c90 0x7f08440a5150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c1034b0 0x7f085c19aa90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f085c10bfc0 0x7f085c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 --2- 172.21.15.144:0/4273002913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085c102b90 0x7f085c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 >> 172.21.15.144:0/4273002913 conn(0x7f085c0fc610 msgr2=0x7f085c0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 shutdown_connections 2024-09-05T07:50:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:23.586+0000 7f0862600640 1 -- 172.21.15.144:0/4273002913 wait complete. 2024-09-05T07:50:23.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:23 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2652769038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T07:50:23.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:23 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2548961317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T07:50:23.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:23 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2652769038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T07:50:23.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:23 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2548961317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T07:50:23.757 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574927 for osd.1 2024-09-05T07:50:23.758 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:24.477 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874273 got 279172874277 for osd.9 2024-09-05T07:50:24.477 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:24.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:24 smithi144 ceph-mon[29535]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-05T07:50:24.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:24 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4273002913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T07:50:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:24 smithi175 ceph-mon[34585]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-05T07:50:24.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:24 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4273002913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T07:50:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:24 smithi154 ceph-mon[34710]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-05T07:50:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:24 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4273002913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T07:50:25.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528370 got 193273528374 for osd.6 2024-09-05T07:50:25.232 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:25.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738452 for osd.0 2024-09-05T07:50:25.895 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:26.450 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710750 got 300647710752 for osd.10 2024-09-05T07:50:26.450 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:26.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:26 smithi175 ceph-mon[34585]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:26.636 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:26 smithi144 ceph-mon[29535]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:26.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.638+0000 7fab97200640 1 -- 172.21.15.144:0/972833767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 msgr2=0x7fab98104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.638+0000 7fab97200640 1 --2- 172.21.15.144:0/972833767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab98104210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab88009900 tx=0x7fab8802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 -- 172.21.15.144:0/972833767 shutdown_connections 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 --2- 172.21.15.144:0/972833767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab981047e0 0x7fab98108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 --2- 172.21.15.144:0/972833767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab98108f60 0x7fab98110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 --2- 172.21.15.144:0/972833767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab98104210 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 -- 172.21.15.144:0/972833767 >> 172.21.15.144:0/972833767 conn(0x7fab980ff8d0 msgr2=0x7fab98101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 -- 172.21.15.144:0/972833767 shutdown_connections 2024-09-05T07:50:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.639+0000 7fab97200640 1 -- 172.21.15.144:0/972833767 wait complete. 2024-09-05T07:50:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 Processor -- start 2024-09-05T07:50:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 -- start start 2024-09-05T07:50:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab981047e0 0x7fab9819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab98108f60 0x7fab9819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab98114010 con 0x7fab98103e30 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab98113e90 con 0x7fab98108f60 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab97200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab98114190 con 0x7fab981047e0 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab95e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab95e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48058/0 (socket says 172.21.15.144:48058) 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab95e00640 1 -- 172.21.15.144:0/3006884416 learned_addr learned my addr 172.21.15.144:0/3006884416 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.640+0000 7fab95400640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab981047e0 0x7fab9819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab96800640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab98108f60 0x7fab9819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 -- 172.21.15.144:0/3006884416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab981047e0 msgr2=0x7fab9819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab981047e0 0x7fab9819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 -- 172.21.15.144:0/3006884416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab98108f60 msgr2=0x7fab9819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab98108f60 0x7fab9819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 -- 172.21.15.144:0/3006884416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9819f440 con 0x7fab98103e30 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab95e00640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab88004770 tx=0x7fab88003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8803f070 con 0x7fab98103e30 2024-09-05T07:50:26.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9819f6d0 con 0x7fab98103e30 2024-09-05T07:50:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.641+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab88031ca0 con 0x7fab98103e30 2024-09-05T07:50:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.642+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88035030 con 0x7fab98103e30 2024-09-05T07:50:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.642+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab981a7010 con 0x7fab98103e30 2024-09-05T07:50:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.643+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab98105310 con 0x7fab98103e30 2024-09-05T07:50:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.645+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fab88042070 con 0x7fab98103e30 2024-09-05T07:50:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.646+0000 7fab8ea00640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 0x7fab7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.646+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fab880ef560 con 0x7fab98103e30 2024-09-05T07:50:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.646+0000 7fab95400640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 0x7fab7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.647+0000 7fab95400640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 0x7fab7c0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab980ffcf0 tx=0x7fab8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.650+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab880bbca0 con 0x7fab98103e30 2024-09-05T07:50:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:26 smithi154 ceph-mon[34710]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:26.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.839+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fab9810c140 con 0x7fab98103e30 2024-09-05T07:50:26.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.839+0000 7fab8ea00640 1 -- 172.21.15.144:0/3006884416 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab880bffa0 con 0x7fab98103e30 2024-09-05T07:50:26.841 INFO:teuthology.orchestra.run.smithi144.stdout:77309411404 2024-09-05T07:50:26.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 msgr2=0x7fab7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:26.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 0x7fab7c0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab980ffcf0 tx=0x7fab8400b390 comp rx=0 tx=0).stop 2024-09-05T07:50:26.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 msgr2=0x7fab9819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab88004770 tx=0x7fab88003c10 comp rx=0 tx=0).stop 2024-09-05T07:50:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 shutdown_connections 2024-09-05T07:50:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fab7c0a2c10 0x7fab7c0a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab98108f60 0x7fab9819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab981047e0 0x7fab9819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 --2- 172.21.15.144:0/3006884416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab98103e30 0x7fab9819a490 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:26.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 >> 172.21.15.144:0/3006884416 conn(0x7fab980ff8d0 msgr2=0x7fab98100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:26.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 shutdown_connections 2024-09-05T07:50:26.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:26.842+0000 7fab97200640 1 -- 172.21.15.144:0/3006884416 wait complete. 2024-09-05T07:50:27.566 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:27 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3006884416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T07:50:27.566 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.566 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:27 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:27 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3006884416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T07:50:27.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:27 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.610 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411404 for osd.2 2024-09-05T07:50:27.611 DEBUG:teuthology.parallel:result is None 2024-09-05T07:50:27.611 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T07:50:27.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T07:50:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:27 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3006884416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T07:50:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:27 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:27.994 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:28.462 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:28 smithi144 ceph-mon[29535]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:28.462 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:50:28.462 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:50:28.462 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:28.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 -- 172.21.15.144:0/1072896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 msgr2=0x7f7e841021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:28.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 --2- 172.21.15.144:0/1072896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e841021d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009900 tx=0x7f7e7402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 -- 172.21.15.144:0/1072896827 shutdown_connections 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 --2- 172.21.15.144:0/1072896827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e84106f20 0x7f7e8410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 --2- 172.21.15.144:0/1072896827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e841027a0 0x7f7e841067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 --2- 172.21.15.144:0/1072896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e841021d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 -- 172.21.15.144:0/1072896827 >> 172.21.15.144:0/1072896827 conn(0x7f7e840fd8b0 msgr2=0x7f7e840ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 -- 172.21.15.144:0/1072896827 shutdown_connections 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.572+0000 7f7e89a00640 1 -- 172.21.15.144:0/1072896827 wait complete. 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 Processor -- start 2024-09-05T07:50:28.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 -- start start 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e84198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 0x7f7e8419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84111f80 con 0x7f7e84101df0 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84111e00 con 0x7f7e841027a0 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.573+0000 7f7e89a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84112100 con 0x7f7e84106f20 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e83400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 0x7f7e8419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e84198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35744/0 (socket says 172.21.15.144:35744) 2024-09-05T07:50:28.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 -- 172.21.15.144:0/147938677 learned_addr learned my addr 172.21.15.144:0/147938677 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:28.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 -- 172.21.15.144:0/147938677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 msgr2=0x7f7e8419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:28.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 0x7f7e8419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 -- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 msgr2=0x7f7e84198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e84198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 -- 172.21.15.144:0/147938677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8419d3b0 con 0x7f7e841027a0 2024-09-05T07:50:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e83400640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 0x7f7e8419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e82a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e84198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.574+0000 7f7e7be00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.575+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00cd80 con 0x7f7e841027a0 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.575+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c005500 con 0x7f7e841027a0 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.575+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c010690 con 0x7f7e841027a0 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.575+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8419d6a0 con 0x7f7e841027a0 2024-09-05T07:50:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.575+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a4f80 con 0x7f7e841027a0 2024-09-05T07:50:28.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.576+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e841021d0 con 0x7f7e841027a0 2024-09-05T07:50:28.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.578+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7e6c0046c0 con 0x7f7e841027a0 2024-09-05T07:50:28.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.579+0000 7f7e7b400640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 0x7f7e680a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:28.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.579+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f7e6c0cf5d0 con 0x7f7e841027a0 2024-09-05T07:50:28.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.579+0000 7f7e82a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 0x7f7e680a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:28.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.580+0000 7f7e82a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 0x7f7e680a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009230 tx=0x7f7e740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:28.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.581+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e6c09c360 con 0x7f7e841027a0 2024-09-05T07:50:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:28 smithi175 ceph-mon[34585]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:50:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:50:28.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:28 smithi154 ceph-mon[34710]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:50:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:50:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:50:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.753+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e84062630 con 0x7f7e680a2c90 2024-09-05T07:50:28.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.760+0000 7f7e7b400640 1 -- 172.21.15.144:0/147938677 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259020 (secure 0 0 0) 0x7f7e84062630 con 0x7f7e680a2c90 2024-09-05T07:50:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:28.765 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 msgr2=0x7f7e680a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 0x7f7e680a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009230 tx=0x7f7e740058d0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 msgr2=0x7f7e84198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00edf0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 shutdown_connections 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7e680a2c90 0x7f7e680a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841027a0 0x7f7e84198940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e84106f20 0x7f7e8419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 --2- 172.21.15.144:0/147938677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e84101df0 0x7f7e84198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:28.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 >> 172.21.15.144:0/147938677 conn(0x7f7e840fd8b0 msgr2=0x7f7e840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:28.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 shutdown_connections 2024-09-05T07:50:28.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:28.764+0000 7f7e89a00640 1 -- 172.21.15.144:0/147938677 wait complete. 2024-09-05T07:50:29.630 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-05T07:50:27.258721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658893,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":723,"num_read_kb":481,"num_write":427,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369104,"kb_used_data":11472,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572720,"statfs":{"total":1151940427776,"available":1151562465280,"internally_reserved":0,"allocated":11747328,"data_stored":7336503,"data_compressed":176907,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003123"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464731+0000","last_change":"2024-09-05T07:49:14.951174+0000","last_active":"2024-09-05T07:50:06.464731+0000","last_peered":"2024-09-05T07:50:06.464731+0000","last_clean":"2024-09-05T07:50:06.464731+0000","last_became_active":"2024-09-05T07:49:14.950781+0000","last_became_peered":"2024-09-05T07:49:14.950781+0000","last_unstale":"2024-09-05T07:50:06.464731+0000","last_undegraded":"2024-09-05T07:50:06.464731+0000","last_fullsized":"2024-09-05T07:50:06.464731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:15.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467461+0000","last_change":"2024-09-05T07:49:14.948936+0000","last_active":"2024-09-05T07:50:06.467461+0000","last_peered":"2024-09-05T07:50:06.467461+0000","last_clean":"2024-09-05T07:50:06.467461+0000","last_became_active":"2024-09-05T07:49:14.948531+0000","last_became_peered":"2024-09-05T07:49:14.948531+0000","last_unstale":"2024-09-05T07:50:06.467461+0000","last_undegraded":"2024-09-05T07:50:06.467461+0000","last_fullsized":"2024-09-05T07:50:06.467461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:42:22.735935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468230+0000","last_change":"2024-09-05T07:49:14.948848+0000","last_active":"2024-09-05T07:50:06.468230+0000","last_peered":"2024-09-05T07:50:06.468230+0000","last_clean":"2024-09-05T07:50:06.468230+0000","last_became_active":"2024-09-05T07:49:14.948581+0000","last_became_peered":"2024-09-05T07:49:14.948581+0000","last_unstale":"2024-09-05T07:50:06.468230+0000","last_undegraded":"2024-09-05T07:50:06.468230+0000","last_fullsized":"2024-09-05T07:50:06.468230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:53:22.517299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853407+0000","last_change":"2024-09-05T07:49:14.950833+0000","last_active":"2024-09-05T07:50:06.853407+0000","last_peered":"2024-09-05T07:50:06.853407+0000","last_clean":"2024-09-05T07:50:06.853407+0000","last_became_active":"2024-09-05T07:49:14.949905+0000","last_became_peered":"2024-09-05T07:49:14.949905+0000","last_unstale":"2024-09-05T07:50:06.853407+0000","last_undegraded":"2024-09-05T07:50:06.853407+0000","last_fullsized":"2024-09-05T07:50:06.853407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:29:37.999531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464117+0000","last_change":"2024-09-05T07:49:14.957903+0000","last_active":"2024-09-05T07:50:06.464117+0000","last_peered":"2024-09-05T07:50:06.464117+0000","last_clean":"2024-09-05T07:50:06.464117+0000","last_became_active":"2024-09-05T07:49:14.957559+0000","last_became_peered":"2024-09-05T07:49:14.957559+0000","last_unstale":"2024-09-05T07:50:06.464117+0000","last_undegraded":"2024-09-05T07:50:06.464117+0000","last_fullsized":"2024-09-05T07:50:06.464117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:50.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851818+0000","last_change":"2024-09-05T07:49:14.951216+0000","last_active":"2024-09-05T07:50:06.851818+0000","last_peered":"2024-09-05T07:50:06.851818+0000","last_clean":"2024-09-05T07:50:06.851818+0000","last_became_active":"2024-09-05T07:49:14.950518+0000","last_became_peered":"2024-09-05T07:49:14.950518+0000","last_unstale":"2024-09-05T07:50:06.851818+0000","last_undegraded":"2024-09-05T07:50:06.851818+0000","last_fullsized":"2024-09-05T07:50:06.851818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:05.373083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466756+0000","last_change":"2024-09-05T07:49:14.952832+0000","last_active":"2024-09-05T07:50:06.466756+0000","last_peered":"2024-09-05T07:50:06.466756+0000","last_clean":"2024-09-05T07:50:06.466756+0000","last_became_active":"2024-09-05T07:49:14.952470+0000","last_became_peered":"2024-09-05T07:49:14.952470+0000","last_unstale":"2024-09-05T07:50:06.466756+0000","last_undegraded":"2024-09-05T07:50:06.466756+0000","last_fullsized":"2024-09-05T07:50:06.466756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:01.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467806+0000","last_change":"2024-09-05T07:49:14.958144+0000","last_active":"2024-09-05T07:50:06.467806+0000","last_peered":"2024-09-05T07:50:06.467806+0000","last_clean":"2024-09-05T07:50:06.467806+0000","last_became_active":"2024-09-05T07:49:14.957851+0000","last_became_peered":"2024-09-05T07:49:14.957851+0000","last_unstale":"2024-09-05T07:50:06.467806+0000","last_undegraded":"2024-09-05T07:50:06.467806+0000","last_fullsized":"2024-09-05T07:50:06.467806+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:49:37.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465116+0000","last_change":"2024-09-05T07:49:14.954599+0000","last_active":"2024-09-05T07:50:06.465116+0000","last_peered":"2024-09-05T07:50:06.465116+0000","last_clean":"2024-09-05T07:50:06.465116+0000","last_became_active":"2024-09-05T07:49:14.954241+0000","last_became_peered":"2024-09-05T07:49:14.954241+0000","last_unstale":"2024-09-05T07:50:06.465116+0000","last_undegraded":"2024-09-05T07:50:06.465116+0000","last_fullsized":"2024-09-05T07:50:06.465116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.657195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851961+0000","last_change":"2024-09-05T07:49:14.948803+0000","last_active":"2024-09-05T07:50:06.851961+0000","last_peered":"2024-09-05T07:50:06.851961+0000","last_clean":"2024-09-05T07:50:06.851961+0000","last_became_active":"2024-09-05T07:49:14.948388+0000","last_became_peered":"2024-09-05T07:49:14.948388+0000","last_unstale":"2024-09-05T07:50:06.851961+0000","last_undegraded":"2024-09-05T07:50:06.851961+0000","last_fullsized":"2024-09-05T07:50:06.851961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.867734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467073+0000","last_change":"2024-09-05T07:49:14.955055+0000","last_active":"2024-09-05T07:50:06.467073+0000","last_peered":"2024-09-05T07:50:06.467073+0000","last_clean":"2024-09-05T07:50:06.467073+0000","last_became_active":"2024-09-05T07:49:14.954758+0000","last_became_peered":"2024-09-05T07:49:14.954758+0000","last_unstale":"2024-09-05T07:50:06.467073+0000","last_undegraded":"2024-09-05T07:50:06.467073+0000","last_fullsized":"2024-09-05T07:50:06.467073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:52.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853283+0000","last_change":"2024-09-05T07:49:14.947590+0000","last_active":"2024-09-05T07:50:06.853283+0000","last_peered":"2024-09-05T07:50:06.853283+0000","last_clean":"2024-09-05T07:50:06.853283+0000","last_became_active":"2024-09-05T07:49:14.947097+0000","last_became_peered":"2024-09-05T07:49:14.947097+0000","last_unstale":"2024-09-05T07:50:06.853283+0000","last_undegraded":"2024-09-05T07:50:06.853283+0000","last_fullsized":"2024-09-05T07:50:06.853283+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:01.318442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464577+0000","last_change":"2024-09-05T07:49:14.947195+0000","last_active":"2024-09-05T07:50:06.464577+0000","last_peered":"2024-09-05T07:50:06.464577+0000","last_clean":"2024-09-05T07:50:06.464577+0000","last_became_active":"2024-09-05T07:49:14.946874+0000","last_became_peered":"2024-09-05T07:49:14.946874+0000","last_unstale":"2024-09-05T07:50:06.464577+0000","last_undegraded":"2024-09-05T07:50:06.464577+0000","last_fullsized":"2024-09-05T07:50:06.464577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:08.582375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467303+0000","last_change":"2024-09-05T07:49:14.948203+0000","last_active":"2024-09-05T07:50:06.467303+0000","last_peered":"2024-09-05T07:50:06.467303+0000","last_clean":"2024-09-05T07:50:06.467303+0000","last_became_active":"2024-09-05T07:49:14.947748+0000","last_became_peered":"2024-09-05T07:49:14.947748+0000","last_unstale":"2024-09-05T07:50:06.467303+0000","last_undegraded":"2024-09-05T07:50:06.467303+0000","last_fullsized":"2024-09-05T07:50:06.467303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468013+0000","last_change":"2024-09-05T07:49:14.954176+0000","last_active":"2024-09-05T07:50:06.468013+0000","last_peered":"2024-09-05T07:50:06.468013+0000","last_clean":"2024-09-05T07:50:06.468013+0000","last_became_active":"2024-09-05T07:49:14.952078+0000","last_became_peered":"2024-09-05T07:49:14.952078+0000","last_unstale":"2024-09-05T07:50:06.468013+0000","last_undegraded":"2024-09-05T07:50:06.468013+0000","last_fullsized":"2024-09-05T07:50:06.468013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:38:10.311444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464444+0000","last_change":"2024-09-05T07:49:14.958096+0000","last_active":"2024-09-05T07:50:06.464444+0000","last_peered":"2024-09-05T07:50:06.464444+0000","last_clean":"2024-09-05T07:50:06.464444+0000","last_became_active":"2024-09-05T07:49:14.957219+0000","last_became_peered":"2024-09-05T07:49:14.957219+0000","last_unstale":"2024-09-05T07:50:06.464444+0000","last_undegraded":"2024-09-05T07:50:06.464444+0000","last_fullsized":"2024-09-05T07:50:06.464444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:20.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464843+0000","last_change":"2024-09-05T07:49:14.950844+0000","last_active":"2024-09-05T07:50:06.464843+0000","last_peered":"2024-09-05T07:50:06.464843+0000","last_clean":"2024-09-05T07:50:06.464843+0000","last_became_active":"2024-09-05T07:49:14.950423+0000","last_became_peered":"2024-09-05T07:49:14.950423+0000","last_unstale":"2024-09-05T07:50:06.464843+0000","last_undegraded":"2024-09-05T07:50:06.464843+0000","last_fullsized":"2024-09-05T07:50:06.464843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:53.633531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465315+0000","last_change":"2024-09-05T07:49:14.951525+0000","last_active":"2024-09-05T07:50:06.465315+0000","last_peered":"2024-09-05T07:50:06.465315+0000","last_clean":"2024-09-05T07:50:06.465315+0000","last_became_active":"2024-09-05T07:49:14.951007+0000","last_became_peered":"2024-09-05T07:49:14.951007+0000","last_unstale":"2024-09-05T07:50:06.465315+0000","last_undegraded":"2024-09-05T07:50:06.465315+0000","last_fullsized":"2024-09-05T07:50:06.465315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:18:17.895969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462895+0000","last_change":"2024-09-05T07:49:14.968131+0000","last_active":"2024-09-05T07:50:06.462895+0000","last_peered":"2024-09-05T07:50:06.462895+0000","last_clean":"2024-09-05T07:50:06.462895+0000","last_became_active":"2024-09-05T07:49:14.967843+0000","last_became_peered":"2024-09-05T07:49:14.967843+0000","last_unstale":"2024-09-05T07:50:06.462895+0000","last_undegraded":"2024-09-05T07:50:06.462895+0000","last_fullsized":"2024-09-05T07:50:06.462895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:10.271731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464312+0000","last_change":"2024-09-05T07:49:14.944475+0000","last_active":"2024-09-05T07:50:06.464312+0000","last_peered":"2024-09-05T07:50:06.464312+0000","last_clean":"2024-09-05T07:50:06.464312+0000","last_became_active":"2024-09-05T07:49:14.944114+0000","last_became_peered":"2024-09-05T07:49:14.944114+0000","last_unstale":"2024-09-05T07:50:06.464312+0000","last_undegraded":"2024-09-05T07:50:06.464312+0000","last_fullsized":"2024-09-05T07:50:06.464312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:51.097613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464662+0000","last_change":"2024-09-05T07:49:14.955374+0000","last_active":"2024-09-05T07:50:06.464662+0000","last_peered":"2024-09-05T07:50:06.464662+0000","last_clean":"2024-09-05T07:50:06.464662+0000","last_became_active":"2024-09-05T07:49:14.955076+0000","last_became_peered":"2024-09-05T07:49:14.955076+0000","last_unstale":"2024-09-05T07:50:06.464662+0000","last_undegraded":"2024-09-05T07:50:06.464662+0000","last_fullsized":"2024-09-05T07:50:06.464662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:48.784069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464603+0000","last_change":"2024-09-05T07:49:14.957865+0000","last_active":"2024-09-05T07:50:06.464603+0000","last_peered":"2024-09-05T07:50:06.464603+0000","last_clean":"2024-09-05T07:50:06.464603+0000","last_became_active":"2024-09-05T07:49:14.957485+0000","last_became_peered":"2024-09-05T07:49:14.957485+0000","last_unstale":"2024-09-05T07:50:06.464603+0000","last_undegraded":"2024-09-05T07:50:06.464603+0000","last_fullsized":"2024-09-05T07:50:06.464603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:18.126600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467914+0000","last_change":"2024-09-05T07:49:14.957899+0000","last_active":"2024-09-05T07:50:06.467914+0000","last_peered":"2024-09-05T07:50:06.467914+0000","last_clean":"2024-09-05T07:50:06.467914+0000","last_became_active":"2024-09-05T07:49:14.957564+0000","last_became_peered":"2024-09-05T07:49:14.957564+0000","last_unstale":"2024-09-05T07:50:06.467914+0000","last_undegraded":"2024-09-05T07:50:06.467914+0000","last_fullsized":"2024-09-05T07:50:06.467914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:31.162232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467510+0000","last_change":"2024-09-05T07:49:14.958238+0000","last_active":"2024-09-05T07:50:06.467510+0000","last_peered":"2024-09-05T07:50:06.467510+0000","last_clean":"2024-09-05T07:50:06.467510+0000","last_became_active":"2024-09-05T07:49:14.957883+0000","last_became_peered":"2024-09-05T07:49:14.957883+0000","last_unstale":"2024-09-05T07:50:06.467510+0000","last_undegraded":"2024-09-05T07:50:06.467510+0000","last_fullsized":"2024-09-05T07:50:06.467510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:31:42.388350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468033+0000","last_change":"2024-09-05T07:49:14.965003+0000","last_active":"2024-09-05T07:50:06.468033+0000","last_peered":"2024-09-05T07:50:06.468033+0000","last_clean":"2024-09-05T07:50:06.468033+0000","last_became_active":"2024-09-05T07:49:14.964709+0000","last_became_peered":"2024-09-05T07:49:14.964709+0000","last_unstale":"2024-09-05T07:50:06.468033+0000","last_undegraded":"2024-09-05T07:50:06.468033+0000","last_fullsized":"2024-09-05T07:50:06.468033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:06.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463046+0000","last_change":"2024-09-05T07:49:14.946355+0000","last_active":"2024-09-05T07:50:06.463046+0000","last_peered":"2024-09-05T07:50:06.463046+0000","last_clean":"2024-09-05T07:50:06.463046+0000","last_became_active":"2024-09-05T07:49:14.946060+0000","last_became_peered":"2024-09-05T07:49:14.946060+0000","last_unstale":"2024-09-05T07:50:06.463046+0000","last_undegraded":"2024-09-05T07:50:06.463046+0000","last_fullsized":"2024-09-05T07:50:06.463046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:31.578598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465922+0000","last_change":"2024-09-05T07:49:14.947815+0000","last_active":"2024-09-05T07:50:06.465922+0000","last_peered":"2024-09-05T07:50:06.465922+0000","last_clean":"2024-09-05T07:50:06.465922+0000","last_became_active":"2024-09-05T07:49:14.947470+0000","last_became_peered":"2024-09-05T07:49:14.947470+0000","last_unstale":"2024-09-05T07:50:06.465922+0000","last_undegraded":"2024-09-05T07:50:06.465922+0000","last_fullsized":"2024-09-05T07:50:06.465922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:31.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464039+0000","last_change":"2024-09-05T07:49:14.951838+0000","last_active":"2024-09-05T07:50:06.464039+0000","last_peered":"2024-09-05T07:50:06.464039+0000","last_clean":"2024-09-05T07:50:06.464039+0000","last_became_active":"2024-09-05T07:49:14.951505+0000","last_became_peered":"2024-09-05T07:49:14.951505+0000","last_unstale":"2024-09-05T07:50:06.464039+0000","last_undegraded":"2024-09-05T07:50:06.464039+0000","last_fullsized":"2024-09-05T07:50:06.464039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:51:03.739607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.471150+0000","last_change":"2024-09-05T07:50:06.471150+0000","last_active":"2024-09-05T07:50:06.471150+0000","last_peered":"2024-09-05T07:50:06.471150+0000","last_clean":"2024-09-05T07:50:06.471150+0000","last_became_active":"2024-09-05T07:50:06.470817+0000","last_became_peered":"2024-09-05T07:50:06.470817+0000","last_unstale":"2024-09-05T07:50:06.471150+0000","last_undegraded":"2024-09-05T07:50:06.471150+0000","last_fullsized":"2024-09-05T07:50:06.471150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:59.671916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.470260+0000","last_change":"2024-09-05T07:50:06.470260+0000","last_active":"2024-09-05T07:50:06.470260+0000","last_peered":"2024-09-05T07:50:06.470260+0000","last_clean":"2024-09-05T07:50:06.470260+0000","last_became_active":"2024-09-05T07:50:06.469831+0000","last_became_peered":"2024-09-05T07:50:06.469831+0000","last_unstale":"2024-09-05T07:50:06.470260+0000","last_undegraded":"2024-09-05T07:50:06.470260+0000","last_fullsized":"2024-09-05T07:50:06.470260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:57:10.932375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462254+0000","last_change":"2024-09-05T07:49:14.949907+0000","last_active":"2024-09-05T07:50:06.462254+0000","last_peered":"2024-09-05T07:50:06.462254+0000","last_clean":"2024-09-05T07:50:06.462254+0000","last_became_active":"2024-09-05T07:49:14.949583+0000","last_became_peered":"2024-09-05T07:49:14.949583+0000","last_unstale":"2024-09-05T07:50:06.462254+0000","last_undegraded":"2024-09-05T07:50:06.462254+0000","last_fullsized":"2024-09-05T07:50:06.462254+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:42:38.342496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464051+0000","last_change":"2024-09-05T07:49:14.943501+0000","last_active":"2024-09-05T07:50:06.464051+0000","last_peered":"2024-09-05T07:50:06.464051+0000","last_clean":"2024-09-05T07:50:06.464051+0000","last_became_active":"2024-09-05T07:49:14.943184+0000","last_became_peered":"2024-09-05T07:49:14.943184+0000","last_unstale":"2024-09-05T07:50:06.464051+0000","last_undegraded":"2024-09-05T07:50:06.464051+0000","last_fullsized":"2024-09-05T07:50:06.464051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:11:30.840749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463942+0000","last_change":"2024-09-05T07:49:14.947161+0000","last_active":"2024-09-05T07:50:06.463942+0000","last_peered":"2024-09-05T07:50:06.463942+0000","last_clean":"2024-09-05T07:50:06.463942+0000","last_became_active":"2024-09-05T07:49:14.946830+0000","last_became_peered":"2024-09-05T07:49:14.946830+0000","last_unstale":"2024-09-05T07:50:06.463942+0000","last_undegraded":"2024-09-05T07:50:06.463942+0000","last_fullsized":"2024-09-05T07:50:06.463942+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:24:03.193771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:23.442266+0000","last_change":"2024-09-05T07:49:12.623481+0000","last_active":"2024-09-05T07:50:23.442266+0000","last_peered":"2024-09-05T07:50:23.442266+0000","last_clean":"2024-09-05T07:50:23.442266+0000","last_became_active":"2024-09-05T07:49:12.623138+0000","last_became_peered":"2024-09-05T07:49:12.623138+0000","last_unstale":"2024-09-05T07:50:23.442266+0000","last_undegraded":"2024-09-05T07:50:23.442266+0000","last_fullsized":"2024-09-05T07:50:23.442266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:05:20.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.471612+0000","last_change":"2024-09-05T07:50:06.471612+0000","last_active":"2024-09-05T07:50:06.471612+0000","last_peered":"2024-09-05T07:50:06.471612+0000","last_clean":"2024-09-05T07:50:06.471612+0000","last_became_active":"2024-09-05T07:50:06.471230+0000","last_became_peered":"2024-09-05T07:50:06.471230+0000","last_unstale":"2024-09-05T07:50:06.471612+0000","last_undegraded":"2024-09-05T07:50:06.471612+0000","last_fullsized":"2024-09-05T07:50:06.471612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:03.405306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851945+0000","last_change":"2024-09-05T07:49:12.622424+0000","last_active":"2024-09-05T07:50:06.851945+0000","last_peered":"2024-09-05T07:50:06.851945+0000","last_clean":"2024-09-05T07:50:06.851945+0000","last_became_active":"2024-09-05T07:49:12.622081+0000","last_became_peered":"2024-09-05T07:49:12.622081+0000","last_unstale":"2024-09-05T07:50:06.851945+0000","last_undegraded":"2024-09-05T07:50:06.851945+0000","last_fullsized":"2024-09-05T07:50:06.851945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:12.531564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464179+0000","last_change":"2024-09-05T07:49:12.619623+0000","last_active":"2024-09-05T07:50:06.464179+0000","last_peered":"2024-09-05T07:50:06.464179+0000","last_clean":"2024-09-05T07:50:06.464179+0000","last_became_active":"2024-09-05T07:49:12.618756+0000","last_became_peered":"2024-09-05T07:49:12.618756+0000","last_unstale":"2024-09-05T07:50:06.464179+0000","last_undegraded":"2024-09-05T07:50:06.464179+0000","last_fullsized":"2024-09-05T07:50:06.464179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:57:55.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467899+0000","last_change":"2024-09-05T07:49:14.966157+0000","last_active":"2024-09-05T07:50:06.467899+0000","last_peered":"2024-09-05T07:50:06.467899+0000","last_clean":"2024-09-05T07:50:06.467899+0000","last_became_active":"2024-09-05T07:49:14.963557+0000","last_became_peered":"2024-09-05T07:49:14.963557+0000","last_unstale":"2024-09-05T07:50:06.467899+0000","last_undegraded":"2024-09-05T07:50:06.467899+0000","last_fullsized":"2024-09-05T07:50:06.467899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:17.900388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468488+0000","last_change":"2024-09-05T07:49:12.620531+0000","last_active":"2024-09-05T07:50:06.468488+0000","last_peered":"2024-09-05T07:50:06.468488+0000","last_clean":"2024-09-05T07:50:06.468488+0000","last_became_active":"2024-09-05T07:49:12.620227+0000","last_became_peered":"2024-09-05T07:49:12.620227+0000","last_unstale":"2024-09-05T07:50:06.468488+0000","last_undegraded":"2024-09-05T07:50:06.468488+0000","last_fullsized":"2024-09-05T07:50:06.468488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:43.694290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464886+0000","last_change":"2024-09-05T07:49:14.964372+0000","last_active":"2024-09-05T07:50:06.464886+0000","last_peered":"2024-09-05T07:50:06.464886+0000","last_clean":"2024-09-05T07:50:06.464886+0000","last_became_active":"2024-09-05T07:49:14.964017+0000","last_became_peered":"2024-09-05T07:49:14.964017+0000","last_unstale":"2024-09-05T07:50:06.464886+0000","last_undegraded":"2024-09-05T07:50:06.464886+0000","last_fullsized":"2024-09-05T07:50:06.464886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:21:05.059035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:21.438850+0000","last_change":"2024-09-05T07:49:12.617764+0000","last_active":"2024-09-05T07:50:21.438850+0000","last_peered":"2024-09-05T07:50:21.438850+0000","last_clean":"2024-09-05T07:50:21.438850+0000","last_became_active":"2024-09-05T07:49:12.617362+0000","last_became_peered":"2024-09-05T07:49:12.617362+0000","last_unstale":"2024-09-05T07:50:21.438850+0000","last_undegraded":"2024-09-05T07:50:21.438850+0000","last_fullsized":"2024-09-05T07:50:21.438850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:27.291110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465000+0000","last_change":"2024-09-05T07:49:14.946462+0000","last_active":"2024-09-05T07:50:06.465000+0000","last_peered":"2024-09-05T07:50:06.465000+0000","last_clean":"2024-09-05T07:50:06.465000+0000","last_became_active":"2024-09-05T07:49:14.946148+0000","last_became_peered":"2024-09-05T07:49:14.946148+0000","last_unstale":"2024-09-05T07:50:06.465000+0000","last_undegraded":"2024-09-05T07:50:06.465000+0000","last_fullsized":"2024-09-05T07:50:06.465000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:58.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466962+0000","last_change":"2024-09-05T07:49:12.624126+0000","last_active":"2024-09-05T07:50:06.466962+0000","last_peered":"2024-09-05T07:50:06.466962+0000","last_clean":"2024-09-05T07:50:06.466962+0000","last_became_active":"2024-09-05T07:49:12.623552+0000","last_became_peered":"2024-09-05T07:49:12.623552+0000","last_unstale":"2024-09-05T07:50:06.466962+0000","last_undegraded":"2024-09-05T07:50:06.466962+0000","last_fullsized":"2024-09-05T07:50:06.466962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:32.068841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467362+0000","last_change":"2024-09-05T07:49:14.953564+0000","last_active":"2024-09-05T07:50:06.467362+0000","last_peered":"2024-09-05T07:50:06.467362+0000","last_clean":"2024-09-05T07:50:06.467362+0000","last_became_active":"2024-09-05T07:49:14.953257+0000","last_became_peered":"2024-09-05T07:49:14.953257+0000","last_unstale":"2024-09-05T07:50:06.467362+0000","last_undegraded":"2024-09-05T07:50:06.467362+0000","last_fullsized":"2024-09-05T07:50:06.467362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:46.140705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.469097+0000","last_change":"2024-09-05T07:49:12.923484+0000","last_active":"2024-09-05T07:50:06.469097+0000","last_peered":"2024-09-05T07:50:06.469097+0000","last_clean":"2024-09-05T07:50:06.469097+0000","last_became_active":"2024-09-05T07:49:12.923039+0000","last_became_peered":"2024-09-05T07:49:12.923039+0000","last_unstale":"2024-09-05T07:50:06.469097+0000","last_undegraded":"2024-09-05T07:50:06.469097+0000","last_fullsized":"2024-09-05T07:50:06.469097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:25:32.918343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464619+0000","last_change":"2024-09-05T07:49:14.946368+0000","last_active":"2024-09-05T07:50:06.464619+0000","last_peered":"2024-09-05T07:50:06.464619+0000","last_clean":"2024-09-05T07:50:06.464619+0000","last_became_active":"2024-09-05T07:49:14.946023+0000","last_became_peered":"2024-09-05T07:49:14.946023+0000","last_unstale":"2024-09-05T07:50:06.464619+0000","last_undegraded":"2024-09-05T07:50:06.464619+0000","last_fullsized":"2024-09-05T07:50:06.464619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:27.579086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:21.439009+0000","last_change":"2024-09-05T07:49:12.623923+0000","last_active":"2024-09-05T07:50:21.439009+0000","last_peered":"2024-09-05T07:50:21.439009+0000","last_clean":"2024-09-05T07:50:21.439009+0000","last_became_active":"2024-09-05T07:49:12.623559+0000","last_became_peered":"2024-09-05T07:49:12.623559+0000","last_unstale":"2024-09-05T07:50:21.439009+0000","last_undegraded":"2024-09-05T07:50:21.439009+0000","last_fullsized":"2024-09-05T07:50:21.439009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:10.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465701+0000","last_change":"2024-09-05T07:49:14.953936+0000","last_active":"2024-09-05T07:50:06.465701+0000","last_peered":"2024-09-05T07:50:06.465701+0000","last_clean":"2024-09-05T07:50:06.465701+0000","last_became_active":"2024-09-05T07:49:14.952830+0000","last_became_peered":"2024-09-05T07:49:14.952830+0000","last_unstale":"2024-09-05T07:50:06.465701+0000","last_undegraded":"2024-09-05T07:50:06.465701+0000","last_fullsized":"2024-09-05T07:50:06.465701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:26.907025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462485+0000","last_change":"2024-09-05T07:49:12.623299+0000","last_active":"2024-09-05T07:50:06.462485+0000","last_peered":"2024-09-05T07:50:06.462485+0000","last_clean":"2024-09-05T07:50:06.462485+0000","last_became_active":"2024-09-05T07:49:12.622942+0000","last_became_peered":"2024-09-05T07:49:12.622942+0000","last_unstale":"2024-09-05T07:50:06.462485+0000","last_undegraded":"2024-09-05T07:50:06.462485+0000","last_fullsized":"2024-09-05T07:50:06.462485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:59:07.846104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464022+0000","last_change":"2024-09-05T07:49:14.959269+0000","last_active":"2024-09-05T07:50:06.464022+0000","last_peered":"2024-09-05T07:50:06.464022+0000","last_clean":"2024-09-05T07:50:06.464022+0000","last_became_active":"2024-09-05T07:49:14.956838+0000","last_became_peered":"2024-09-05T07:49:14.956838+0000","last_unstale":"2024-09-05T07:50:06.464022+0000","last_undegraded":"2024-09-05T07:50:06.464022+0000","last_fullsized":"2024-09-05T07:50:06.464022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:40.047519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468388+0000","last_change":"2024-09-05T07:49:12.618068+0000","last_active":"2024-09-05T07:50:06.468388+0000","last_peered":"2024-09-05T07:50:06.468388+0000","last_clean":"2024-09-05T07:50:06.468388+0000","last_became_active":"2024-09-05T07:49:12.617125+0000","last_became_peered":"2024-09-05T07:49:12.617125+0000","last_unstale":"2024-09-05T07:50:06.468388+0000","last_undegraded":"2024-09-05T07:50:06.468388+0000","last_fullsized":"2024-09-05T07:50:06.468388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:39:50.999342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467220+0000","last_change":"2024-09-05T07:49:14.956131+0000","last_active":"2024-09-05T07:50:06.467220+0000","last_peered":"2024-09-05T07:50:06.467220+0000","last_clean":"2024-09-05T07:50:06.467220+0000","last_became_active":"2024-09-05T07:49:14.955817+0000","last_became_peered":"2024-09-05T07:49:14.955817+0000","last_unstale":"2024-09-05T07:50:06.467220+0000","last_undegraded":"2024-09-05T07:50:06.467220+0000","last_fullsized":"2024-09-05T07:50:06.467220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:14.800599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:24.443190+0000","last_change":"2024-09-05T07:49:12.620990+0000","last_active":"2024-09-05T07:50:24.443190+0000","last_peered":"2024-09-05T07:50:24.443190+0000","last_clean":"2024-09-05T07:50:24.443190+0000","last_became_active":"2024-09-05T07:49:12.620571+0000","last_became_peered":"2024-09-05T07:49:12.620571+0000","last_unstale":"2024-09-05T07:50:24.443190+0000","last_undegraded":"2024-09-05T07:50:24.443190+0000","last_fullsized":"2024-09-05T07:50:24.443190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:01.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466706+0000","last_change":"2024-09-05T07:49:14.954588+0000","last_active":"2024-09-05T07:50:06.466706+0000","last_peered":"2024-09-05T07:50:06.466706+0000","last_clean":"2024-09-05T07:50:06.466706+0000","last_became_active":"2024-09-05T07:49:14.954252+0000","last_became_peered":"2024-09-05T07:49:14.954252+0000","last_unstale":"2024-09-05T07:50:06.466706+0000","last_undegraded":"2024-09-05T07:50:06.466706+0000","last_fullsized":"2024-09-05T07:50:06.466706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:31.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464720+0000","last_change":"2024-09-05T07:49:12.922771+0000","last_active":"2024-09-05T07:50:06.464720+0000","last_peered":"2024-09-05T07:50:06.464720+0000","last_clean":"2024-09-05T07:50:06.464720+0000","last_became_active":"2024-09-05T07:49:12.922377+0000","last_became_peered":"2024-09-05T07:49:12.922377+0000","last_unstale":"2024-09-05T07:50:06.464720+0000","last_undegraded":"2024-09-05T07:50:06.464720+0000","last_fullsized":"2024-09-05T07:50:06.464720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:54.376164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852870+0000","last_change":"2024-09-05T07:50:06.852870+0000","last_active":"2024-09-05T07:50:06.852870+0000","last_peered":"2024-09-05T07:50:06.852870+0000","last_clean":"2024-09-05T07:50:06.852870+0000","last_became_active":"2024-09-05T07:50:06.852431+0000","last_became_peered":"2024-09-05T07:50:06.852431+0000","last_unstale":"2024-09-05T07:50:06.852870+0000","last_undegraded":"2024-09-05T07:50:06.852870+0000","last_fullsized":"2024-09-05T07:50:06.852870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:14:40.779070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465427+0000","last_change":"2024-09-05T07:49:12.623690+0000","last_active":"2024-09-05T07:50:06.465427+0000","last_peered":"2024-09-05T07:50:06.465427+0000","last_clean":"2024-09-05T07:50:06.465427+0000","last_became_active":"2024-09-05T07:49:12.623315+0000","last_became_peered":"2024-09-05T07:49:12.623315+0000","last_unstale":"2024-09-05T07:50:06.465427+0000","last_undegraded":"2024-09-05T07:50:06.465427+0000","last_fullsized":"2024-09-05T07:50:06.465427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:01.293175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464243+0000","last_change":"2024-09-05T07:49:14.943190+0000","last_active":"2024-09-05T07:50:06.464243+0000","last_peered":"2024-09-05T07:50:06.464243+0000","last_clean":"2024-09-05T07:50:06.464243+0000","last_became_active":"2024-09-05T07:49:14.942863+0000","last_became_peered":"2024-09-05T07:49:14.942863+0000","last_unstale":"2024-09-05T07:50:06.464243+0000","last_undegraded":"2024-09-05T07:50:06.464243+0000","last_fullsized":"2024-09-05T07:50:06.464243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:54.401096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465155+0000","last_change":"2024-09-05T07:49:12.623328+0000","last_active":"2024-09-05T07:50:06.465155+0000","last_peered":"2024-09-05T07:50:06.465155+0000","last_clean":"2024-09-05T07:50:06.465155+0000","last_became_active":"2024-09-05T07:49:12.622993+0000","last_became_peered":"2024-09-05T07:49:12.622993+0000","last_unstale":"2024-09-05T07:50:06.465155+0000","last_undegraded":"2024-09-05T07:50:06.465155+0000","last_fullsized":"2024-09-05T07:50:06.465155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:11:27.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467243+0000","last_change":"2024-09-05T07:49:14.951250+0000","last_active":"2024-09-05T07:50:06.467243+0000","last_peered":"2024-09-05T07:50:06.467243+0000","last_clean":"2024-09-05T07:50:06.467243+0000","last_became_active":"2024-09-05T07:49:14.950834+0000","last_became_peered":"2024-09-05T07:49:14.950834+0000","last_unstale":"2024-09-05T07:50:06.467243+0000","last_undegraded":"2024-09-05T07:50:06.467243+0000","last_fullsized":"2024-09-05T07:50:06.467243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:42.992517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.469147+0000","last_change":"2024-09-05T07:49:12.620555+0000","last_active":"2024-09-05T07:50:06.469147+0000","last_peered":"2024-09-05T07:50:06.469147+0000","last_clean":"2024-09-05T07:50:06.469147+0000","last_became_active":"2024-09-05T07:49:12.619847+0000","last_became_peered":"2024-09-05T07:49:12.619847+0000","last_unstale":"2024-09-05T07:50:06.469147+0000","last_undegraded":"2024-09-05T07:50:06.469147+0000","last_fullsized":"2024-09-05T07:50:06.469147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:18:59.833342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466957+0000","last_change":"2024-09-05T07:49:14.952173+0000","last_active":"2024-09-05T07:50:06.466957+0000","last_peered":"2024-09-05T07:50:06.466957+0000","last_clean":"2024-09-05T07:50:06.466957+0000","last_became_active":"2024-09-05T07:49:14.951848+0000","last_became_peered":"2024-09-05T07:49:14.951848+0000","last_unstale":"2024-09-05T07:50:06.466957+0000","last_undegraded":"2024-09-05T07:50:06.466957+0000","last_fullsized":"2024-09-05T07:50:06.466957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:21.439580+0000","last_change":"2024-09-05T07:49:12.923318+0000","last_active":"2024-09-05T07:50:21.439580+0000","last_peered":"2024-09-05T07:50:21.439580+0000","last_clean":"2024-09-05T07:50:21.439580+0000","last_became_active":"2024-09-05T07:49:12.922965+0000","last_became_peered":"2024-09-05T07:49:12.922965+0000","last_unstale":"2024-09-05T07:50:21.439580+0000","last_undegraded":"2024-09-05T07:50:21.439580+0000","last_fullsized":"2024-09-05T07:50:21.439580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:19.576198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467174+0000","last_change":"2024-09-05T07:49:14.950067+0000","last_active":"2024-09-05T07:50:06.467174+0000","last_peered":"2024-09-05T07:50:06.467174+0000","last_clean":"2024-09-05T07:50:06.467174+0000","last_became_active":"2024-09-05T07:49:14.949580+0000","last_became_peered":"2024-09-05T07:49:14.949580+0000","last_unstale":"2024-09-05T07:50:06.467174+0000","last_undegraded":"2024-09-05T07:50:06.467174+0000","last_fullsized":"2024-09-05T07:50:06.467174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:08.754476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467135+0000","last_change":"2024-09-05T07:47:54.520597+0000","last_active":"2024-09-05T07:50:06.467135+0000","last_peered":"2024-09-05T07:50:06.467135+0000","last_clean":"2024-09-05T07:50:06.467135+0000","last_became_active":"2024-09-05T07:47:54.520187+0000","last_became_peered":"2024-09-05T07:47:54.520187+0000","last_unstale":"2024-09-05T07:50:06.467135+0000","last_undegraded":"2024-09-05T07:50:06.467135+0000","last_fullsized":"2024-09-05T07:50:06.467135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_clean_scrub_stamp":"2024-09-05T07:44:23.832394+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:19.382482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853163+0000","last_change":"2024-09-05T07:49:12.618142+0000","last_active":"2024-09-05T07:50:06.853163+0000","last_peered":"2024-09-05T07:50:06.853163+0000","last_clean":"2024-09-05T07:50:06.853163+0000","last_became_active":"2024-09-05T07:49:12.617799+0000","last_became_peered":"2024-09-05T07:49:12.617799+0000","last_unstale":"2024-09-05T07:50:06.853163+0000","last_undegraded":"2024-09-05T07:50:06.853163+0000","last_fullsized":"2024-09-05T07:50:06.853163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:34:55.843402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467734+0000","last_change":"2024-09-05T07:49:14.962066+0000","last_active":"2024-09-05T07:50:06.467734+0000","last_peered":"2024-09-05T07:50:06.467734+0000","last_clean":"2024-09-05T07:50:06.467734+0000","last_became_active":"2024-09-05T07:49:14.952793+0000","last_became_peered":"2024-09-05T07:49:14.952793+0000","last_unstale":"2024-09-05T07:50:06.467734+0000","last_undegraded":"2024-09-05T07:50:06.467734+0000","last_fullsized":"2024-09-05T07:50:06.467734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:53.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466944+0000","last_change":"2024-09-05T07:49:12.624350+0000","last_active":"2024-09-05T07:50:06.466944+0000","last_peered":"2024-09-05T07:50:06.466944+0000","last_clean":"2024-09-05T07:50:06.466944+0000","last_became_active":"2024-09-05T07:49:12.623907+0000","last_became_peered":"2024-09-05T07:49:12.623907+0000","last_unstale":"2024-09-05T07:50:06.466944+0000","last_undegraded":"2024-09-05T07:50:06.466944+0000","last_fullsized":"2024-09-05T07:50:06.466944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.663789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464050+0000","last_change":"2024-09-05T07:49:14.953372+0000","last_active":"2024-09-05T07:50:06.464050+0000","last_peered":"2024-09-05T07:50:06.464050+0000","last_clean":"2024-09-05T07:50:06.464050+0000","last_became_active":"2024-09-05T07:49:14.952986+0000","last_became_peered":"2024-09-05T07:49:14.952986+0000","last_unstale":"2024-09-05T07:50:06.464050+0000","last_undegraded":"2024-09-05T07:50:06.464050+0000","last_fullsized":"2024-09-05T07:50:06.464050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:01:55.338289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:21.438944+0000","last_change":"2024-09-05T07:49:12.923463+0000","last_active":"2024-09-05T07:50:21.438944+0000","last_peered":"2024-09-05T07:50:21.438944+0000","last_clean":"2024-09-05T07:50:21.438944+0000","last_became_active":"2024-09-05T07:49:12.923105+0000","last_became_peered":"2024-09-05T07:49:12.923105+0000","last_unstale":"2024-09-05T07:50:21.438944+0000","last_undegraded":"2024-09-05T07:50:21.438944+0000","last_fullsized":"2024-09-05T07:50:21.438944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:25:21.795954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852962+0000","last_change":"2024-09-05T07:50:06.852962+0000","last_active":"2024-09-05T07:50:06.852962+0000","last_peered":"2024-09-05T07:50:06.852962+0000","last_clean":"2024-09-05T07:50:06.852962+0000","last_became_active":"2024-09-05T07:50:06.852616+0000","last_became_peered":"2024-09-05T07:50:06.852616+0000","last_unstale":"2024-09-05T07:50:06.852962+0000","last_undegraded":"2024-09-05T07:50:06.852962+0000","last_fullsized":"2024-09-05T07:50:06.852962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:56:06.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:21.439208+0000","last_change":"2024-09-05T07:49:12.618510+0000","last_active":"2024-09-05T07:50:21.439208+0000","last_peered":"2024-09-05T07:50:21.439208+0000","last_clean":"2024-09-05T07:50:21.439208+0000","last_became_active":"2024-09-05T07:49:12.618160+0000","last_became_peered":"2024-09-05T07:49:12.618160+0000","last_unstale":"2024-09-05T07:50:21.439208+0000","last_undegraded":"2024-09-05T07:50:21.439208+0000","last_fullsized":"2024-09-05T07:50:21.439208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:52:12.432287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852130+0000","last_change":"2024-09-05T07:49:14.953989+0000","last_active":"2024-09-05T07:50:06.852130+0000","last_peered":"2024-09-05T07:50:06.852130+0000","last_clean":"2024-09-05T07:50:06.852130+0000","last_became_active":"2024-09-05T07:49:14.953651+0000","last_became_peered":"2024-09-05T07:49:14.953651+0000","last_unstale":"2024-09-05T07:50:06.852130+0000","last_undegraded":"2024-09-05T07:50:06.852130+0000","last_fullsized":"2024-09-05T07:50:06.852130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:36.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465072+0000","last_change":"2024-09-05T07:49:12.923661+0000","last_active":"2024-09-05T07:50:06.465072+0000","last_peered":"2024-09-05T07:50:06.465072+0000","last_clean":"2024-09-05T07:50:06.465072+0000","last_became_active":"2024-09-05T07:49:12.923273+0000","last_became_peered":"2024-09-05T07:49:12.923273+0000","last_unstale":"2024-09-05T07:50:06.465072+0000","last_undegraded":"2024-09-05T07:50:06.465072+0000","last_fullsized":"2024-09-05T07:50:06.465072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:08.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851984+0000","last_change":"2024-09-05T07:49:14.964797+0000","last_active":"2024-09-05T07:50:06.851984+0000","last_peered":"2024-09-05T07:50:06.851984+0000","last_clean":"2024-09-05T07:50:06.851984+0000","last_became_active":"2024-09-05T07:49:14.964411+0000","last_became_peered":"2024-09-05T07:49:14.964411+0000","last_unstale":"2024-09-05T07:50:06.851984+0000","last_undegraded":"2024-09-05T07:50:06.851984+0000","last_fullsized":"2024-09-05T07:50:06.851984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:55:37.150270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465826+0000","last_change":"2024-09-05T07:49:12.924896+0000","last_active":"2024-09-05T07:50:06.465826+0000","last_peered":"2024-09-05T07:50:06.465826+0000","last_clean":"2024-09-05T07:50:06.465826+0000","last_became_active":"2024-09-05T07:49:12.924556+0000","last_became_peered":"2024-09-05T07:49:12.924556+0000","last_unstale":"2024-09-05T07:50:06.465826+0000","last_undegraded":"2024-09-05T07:50:06.465826+0000","last_fullsized":"2024-09-05T07:50:06.465826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:02:37.433963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464155+0000","last_change":"2024-09-05T07:49:14.953635+0000","last_active":"2024-09-05T07:50:06.464155+0000","last_peered":"2024-09-05T07:50:06.464155+0000","last_clean":"2024-09-05T07:50:06.464155+0000","last_became_active":"2024-09-05T07:49:14.950967+0000","last_became_peered":"2024-09-05T07:49:14.950967+0000","last_unstale":"2024-09-05T07:50:06.464155+0000","last_undegraded":"2024-09-05T07:50:06.464155+0000","last_fullsized":"2024-09-05T07:50:06.464155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:20:47.539927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'15","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465388+0000","last_change":"2024-09-05T07:49:12.621601+0000","last_active":"2024-09-05T07:50:06.465388+0000","last_peered":"2024-09-05T07:50:06.465388+0000","last_clean":"2024-09-05T07:50:06.465388+0000","last_became_active":"2024-09-05T07:49:12.621285+0000","last_became_peered":"2024-09-05T07:49:12.621285+0000","last_unstale":"2024-09-05T07:50:06.465388+0000","last_undegraded":"2024-09-05T07:50:06.465388+0000","last_fullsized":"2024-09-05T07:50:06.465388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:54:28.216480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468134+0000","last_change":"2024-09-05T07:49:14.963083+0000","last_active":"2024-09-05T07:50:06.468134+0000","last_peered":"2024-09-05T07:50:06.468134+0000","last_clean":"2024-09-05T07:50:06.468134+0000","last_became_active":"2024-09-05T07:49:14.962763+0000","last_became_peered":"2024-09-05T07:49:14.962763+0000","last_unstale":"2024-09-05T07:50:06.468134+0000","last_undegraded":"2024-09-05T07:50:06.468134+0000","last_fullsized":"2024-09-05T07:50:06.468134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:41.475517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853262+0000","last_change":"2024-09-05T07:49:12.630250+0000","last_active":"2024-09-05T07:50:06.853262+0000","last_peered":"2024-09-05T07:50:06.853262+0000","last_clean":"2024-09-05T07:50:06.853262+0000","last_became_active":"2024-09-05T07:49:12.629953+0000","last_became_peered":"2024-09-05T07:49:12.629953+0000","last_unstale":"2024-09-05T07:50:06.853262+0000","last_undegraded":"2024-09-05T07:50:06.853262+0000","last_fullsized":"2024-09-05T07:50:06.853262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:30:26.217587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467551+0000","last_change":"2024-09-05T07:49:14.965623+0000","last_active":"2024-09-05T07:50:06.467551+0000","last_peered":"2024-09-05T07:50:06.467551+0000","last_clean":"2024-09-05T07:50:06.467551+0000","last_became_active":"2024-09-05T07:49:14.964544+0000","last_became_peered":"2024-09-05T07:49:14.964544+0000","last_unstale":"2024-09-05T07:50:06.467551+0000","last_undegraded":"2024-09-05T07:50:06.467551+0000","last_fullsized":"2024-09-05T07:50:06.467551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:03:51.723187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464559+0000","last_change":"2024-09-05T07:49:12.922943+0000","last_active":"2024-09-05T07:50:06.464559+0000","last_peered":"2024-09-05T07:50:06.464559+0000","last_clean":"2024-09-05T07:50:06.464559+0000","last_became_active":"2024-09-05T07:49:12.922553+0000","last_became_peered":"2024-09-05T07:49:12.922553+0000","last_unstale":"2024-09-05T07:50:06.464559+0000","last_undegraded":"2024-09-05T07:50:06.464559+0000","last_fullsized":"2024-09-05T07:50:06.464559+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:08:39.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463917+0000","last_change":"2024-09-05T07:49:14.950904+0000","last_active":"2024-09-05T07:50:06.463917+0000","last_peered":"2024-09-05T07:50:06.463917+0000","last_clean":"2024-09-05T07:50:06.463917+0000","last_became_active":"2024-09-05T07:49:14.950553+0000","last_became_peered":"2024-09-05T07:49:14.950553+0000","last_unstale":"2024-09-05T07:50:06.463917+0000","last_undegraded":"2024-09-05T07:50:06.463917+0000","last_fullsized":"2024-09-05T07:50:06.463917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:31:35.255414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468028+0000","last_change":"2024-09-05T07:49:12.617926+0000","last_active":"2024-09-05T07:50:06.468028+0000","last_peered":"2024-09-05T07:50:06.468028+0000","last_clean":"2024-09-05T07:50:06.468028+0000","last_became_active":"2024-09-05T07:49:12.617168+0000","last_became_peered":"2024-09-05T07:49:12.617168+0000","last_unstale":"2024-09-05T07:50:06.468028+0000","last_undegraded":"2024-09-05T07:50:06.468028+0000","last_fullsized":"2024-09-05T07:50:06.468028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:24.934339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464170+0000","last_change":"2024-09-05T07:49:14.951658+0000","last_active":"2024-09-05T07:50:06.464170+0000","last_peered":"2024-09-05T07:50:06.464170+0000","last_clean":"2024-09-05T07:50:06.464170+0000","last_became_active":"2024-09-05T07:49:14.951328+0000","last_became_peered":"2024-09-05T07:49:14.951328+0000","last_unstale":"2024-09-05T07:50:06.464170+0000","last_undegraded":"2024-09-05T07:50:06.464170+0000","last_fullsized":"2024-09-05T07:50:06.464170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:30:06.429805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.860873+0000","last_change":"2024-09-05T07:50:06.860347+0000","last_active":"2024-09-05T07:50:06.860873+0000","last_peered":"2024-09-05T07:50:06.860873+0000","last_clean":"2024-09-05T07:50:06.860873+0000","last_became_active":"2024-09-05T07:50:06.853682+0000","last_became_peered":"2024-09-05T07:50:06.853682+0000","last_unstale":"2024-09-05T07:50:06.860873+0000","last_undegraded":"2024-09-05T07:50:06.860873+0000","last_fullsized":"2024-09-05T07:50:06.860873+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:29.761324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,4],"acting":[11,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468391+0000","last_change":"2024-09-05T07:49:14.963017+0000","last_active":"2024-09-05T07:50:06.468391+0000","last_peered":"2024-09-05T07:50:06.468391+0000","last_clean":"2024-09-05T07:50:06.468391+0000","last_became_active":"2024-09-05T07:49:14.962655+0000","last_became_peered":"2024-09-05T07:49:14.962655+0000","last_unstale":"2024-09-05T07:50:06.468391+0000","last_undegraded":"2024-09-05T07:50:06.468391+0000","last_fullsized":"2024-09-05T07:50:06.468391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:59.068930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.863532+0000","last_change":"2024-09-05T07:50:06.863532+0000","last_active":"2024-09-05T07:50:06.863532+0000","last_peered":"2024-09-05T07:50:06.863532+0000","last_clean":"2024-09-05T07:50:06.863532+0000","last_became_active":"2024-09-05T07:50:06.854452+0000","last_became_peered":"2024-09-05T07:50:06.854452+0000","last_unstale":"2024-09-05T07:50:06.863532+0000","last_undegraded":"2024-09-05T07:50:06.863532+0000","last_fullsized":"2024-09-05T07:50:06.863532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:21.076553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467234+0000","last_change":"2024-09-05T07:49:14.953562+0000","last_active":"2024-09-05T07:50:06.467234+0000","last_peered":"2024-09-05T07:50:06.467234+0000","last_clean":"2024-09-05T07:50:06.467234+0000","last_became_active":"2024-09-05T07:49:14.953242+0000","last_became_peered":"2024-09-05T07:49:14.953242+0000","last_unstale":"2024-09-05T07:50:06.467234+0000","last_undegraded":"2024-09-05T07:50:06.467234+0000","last_fullsized":"2024-09-05T07:50:06.467234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:02.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.470164+0000","last_change":"2024-09-05T07:50:06.470164+0000","last_active":"2024-09-05T07:50:06.470164+0000","last_peered":"2024-09-05T07:50:06.470164+0000","last_clean":"2024-09-05T07:50:06.470164+0000","last_became_active":"2024-09-05T07:50:06.469748+0000","last_became_peered":"2024-09-05T07:50:06.469748+0000","last_unstale":"2024-09-05T07:50:06.470164+0000","last_undegraded":"2024-09-05T07:50:06.470164+0000","last_fullsized":"2024-09-05T07:50:06.470164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:52.591811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464785+0000","last_change":"2024-09-05T07:49:12.624583+0000","last_active":"2024-09-05T07:50:06.464785+0000","last_peered":"2024-09-05T07:50:06.464785+0000","last_clean":"2024-09-05T07:50:06.464785+0000","last_became_active":"2024-09-05T07:49:12.624184+0000","last_became_peered":"2024-09-05T07:49:12.624184+0000","last_unstale":"2024-09-05T07:50:06.464785+0000","last_undegraded":"2024-09-05T07:50:06.464785+0000","last_fullsized":"2024-09-05T07:50:06.464785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:46:33.137089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464561+0000","last_change":"2024-09-05T07:49:14.955735+0000","last_active":"2024-09-05T07:50:06.464561+0000","last_peered":"2024-09-05T07:50:06.464561+0000","last_clean":"2024-09-05T07:50:06.464561+0000","last_became_active":"2024-09-05T07:49:14.955388+0000","last_became_peered":"2024-09-05T07:49:14.955388+0000","last_unstale":"2024-09-05T07:50:06.464561+0000","last_undegraded":"2024-09-05T07:50:06.464561+0000","last_fullsized":"2024-09-05T07:50:06.464561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:07:15.436676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.479510+0000","last_change":"2024-09-05T07:50:06.479120+0000","last_active":"2024-09-05T07:50:06.479510+0000","last_peered":"2024-09-05T07:50:06.479510+0000","last_clean":"2024-09-05T07:50:06.479510+0000","last_became_active":"2024-09-05T07:50:06.468059+0000","last_became_peered":"2024-09-05T07:50:06.468059+0000","last_unstale":"2024-09-05T07:50:06.479510+0000","last_undegraded":"2024-09-05T07:50:06.479510+0000","last_fullsized":"2024-09-05T07:50:06.479510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:05:55.676017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467257+0000","last_change":"2024-09-05T07:49:14.952234+0000","last_active":"2024-09-05T07:50:06.467257+0000","last_peered":"2024-09-05T07:50:06.467257+0000","last_clean":"2024-09-05T07:50:06.467257+0000","last_became_active":"2024-09-05T07:49:14.948805+0000","last_became_peered":"2024-09-05T07:49:14.948805+0000","last_unstale":"2024-09-05T07:50:06.467257+0000","last_undegraded":"2024-09-05T07:50:06.467257+0000","last_fullsized":"2024-09-05T07:50:06.467257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:49.101303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468197+0000","last_change":"2024-09-05T07:49:12.922749+0000","last_active":"2024-09-05T07:50:06.468197+0000","last_peered":"2024-09-05T07:50:06.468197+0000","last_clean":"2024-09-05T07:50:06.468197+0000","last_became_active":"2024-09-05T07:49:12.922415+0000","last_became_peered":"2024-09-05T07:49:12.922415+0000","last_unstale":"2024-09-05T07:50:06.468197+0000","last_undegraded":"2024-09-05T07:50:06.468197+0000","last_fullsized":"2024-09-05T07:50:06.468197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:19:58.163647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467972+0000","last_change":"2024-09-05T07:49:14.957792+0000","last_active":"2024-09-05T07:50:06.467972+0000","last_peered":"2024-09-05T07:50:06.467972+0000","last_clean":"2024-09-05T07:50:06.467972+0000","last_became_active":"2024-09-05T07:49:14.957312+0000","last_became_peered":"2024-09-05T07:49:14.957312+0000","last_unstale":"2024-09-05T07:50:06.467972+0000","last_undegraded":"2024-09-05T07:50:06.467972+0000","last_fullsized":"2024-09-05T07:50:06.467972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:55:17.422990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":95,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:25.443937+0000","last_change":"2024-09-05T07:49:12.621834+0000","last_active":"2024-09-05T07:50:25.443937+0000","last_peered":"2024-09-05T07:50:25.443937+0000","last_clean":"2024-09-05T07:50:25.443937+0000","last_became_active":"2024-09-05T07:49:12.621446+0000","last_became_peered":"2024-09-05T07:49:12.621446+0000","last_unstale":"2024-09-05T07:50:25.443937+0000","last_undegraded":"2024-09-05T07:50:25.443937+0000","last_fullsized":"2024-09-05T07:50:25.443937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:32.790982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68291,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":597,"num_read_kb":372,"num_write":244,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282052,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481820,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":447844,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710753,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1085440,"data_stored":1099956,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874278,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":447774,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135916,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":448152,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364849,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":1041458,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528375,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":447884,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1040350,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":447745,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":447316,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1019904,"data_stored":509707,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":509487,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":958464,"data_stored":448830,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:50:29.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T07:50:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:30.470 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:30 smithi144 ceph-mon[29535]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:30.471 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:30 smithi144 ceph-mon[29535]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 -- 172.21.15.144:0/1190655114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981019c0 msgr2=0x7f5e98101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1190655114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981019c0 0x7f5e98101e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009930 tx=0x7f5e8402a420 comp rx=0 tx=0).stop 2024-09-05T07:50:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 -- 172.21.15.144:0/1190655114 shutdown_connections 2024-09-05T07:50:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1190655114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e98102360 0x7f5e9810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1190655114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981019c0 0x7f5e98101e20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1190655114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e98107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 -- 172.21.15.144:0/1190655114 >> 172.21.15.144:0/1190655114 conn(0x7f5e980fd740 msgr2=0x7f5e980ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 -- 172.21.15.144:0/1190655114 shutdown_connections 2024-09-05T07:50:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.581+0000 7f5e9de00640 1 -- 172.21.15.144:0/1190655114 wait complete. 2024-09-05T07:50:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.582+0000 7f5e9de00640 1 Processor -- start 2024-09-05T07:50:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.582+0000 7f5e9de00640 1 -- start start 2024-09-05T07:50:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.582+0000 7f5e9de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e981019c0 0x7f5e981982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.582+0000 7f5e9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e9819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98111e10 con 0x7f5e98102360 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9de00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98111c90 con 0x7f5e981079c0 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9de00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98111f90 con 0x7f5e981019c0 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48094/0 (socket says 172.21.15.144:48094) 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 -- 172.21.15.144:0/3705430377 learned_addr learned my addr 172.21.15.144:0/3705430377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e981019c0 0x7f5e981982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9d400640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e9819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 -- 172.21.15.144:0/3705430377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e981019c0 msgr2=0x7f5e981982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e981019c0 0x7f5e981982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 -- 172.21.15.144:0/3705430377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 msgr2=0x7f5e9819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e9819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e97e00640 1 -- 172.21.15.144:0/3705430377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9819d2a0 con 0x7f5e98102360 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.583+0000 7f5e9d400640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e9819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e97e00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e8402a940 tx=0x7f5e84003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8403f070 con 0x7f5e98102360 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e84031c90 con 0x7f5e98102360 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84035030 con 0x7f5e98102360 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9819d530 con 0x7f5e98102360 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.584+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9819d9c0 con 0x7f5e98102360 2024-09-05T07:50:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.585+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e98101e20 con 0x7f5e98102360 2024-09-05T07:50:30.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:30 smithi175 ceph-mon[34585]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:30.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:30 smithi175 ceph-mon[34585]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:30.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.587+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5e84042070 con 0x7f5e98102360 2024-09-05T07:50:30.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.588+0000 7f5e95600640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 0x7f5e800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:30.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.588+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f5e840ef7c0 con 0x7f5e98102360 2024-09-05T07:50:30.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.589+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 0x7f5e800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.589+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 0x7f5e800a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009b50 tx=0x7f5e8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.592+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e840bbf00 con 0x7f5e98102360 2024-09-05T07:50:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:30 smithi154 ceph-mon[34710]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:30 smithi154 ceph-mon[34710]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:30.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.766+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e98062630 con 0x7f5e800a2c90 2024-09-05T07:50:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.773+0000 7f5e95600640 1 -- 172.21.15.144:0/3705430377 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259020 (secure 0 0 0) 0x7f5e98062630 con 0x7f5e800a2c90 2024-09-05T07:50:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 msgr2=0x7f5e800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 0x7f5e800a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009b50 tx=0x7f5e8c005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 msgr2=0x7f5e98198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e8402a940 tx=0x7f5e84003b20 comp rx=0 tx=0).stop 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 shutdown_connections 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e800a2c90 0x7f5e800a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981079c0 0x7f5e9819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98102360 0x7f5e98198830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 --2- 172.21.15.144:0/3705430377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e981019c0 0x7f5e981982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 >> 172.21.15.144:0/3705430377 conn(0x7f5e980fd740 msgr2=0x7f5e980fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 shutdown_connections 2024-09-05T07:50:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:30.777+0000 7f5e9de00640 1 -- 172.21.15.144:0/3705430377 wait complete. 2024-09-05T07:50:31.576 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-05T07:50:29.259167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658893,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":758,"num_read_kb":501,"num_write":427,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369104,"kb_used_data":11472,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572720,"statfs":{"total":1151940427776,"available":1151562465280,"internally_reserved":0,"allocated":11747328,"data_stored":7336503,"data_compressed":176907,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002894"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464731+0000","last_change":"2024-09-05T07:49:14.951174+0000","last_active":"2024-09-05T07:50:06.464731+0000","last_peered":"2024-09-05T07:50:06.464731+0000","last_clean":"2024-09-05T07:50:06.464731+0000","last_became_active":"2024-09-05T07:49:14.950781+0000","last_became_peered":"2024-09-05T07:49:14.950781+0000","last_unstale":"2024-09-05T07:50:06.464731+0000","last_undegraded":"2024-09-05T07:50:06.464731+0000","last_fullsized":"2024-09-05T07:50:06.464731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:15.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467461+0000","last_change":"2024-09-05T07:49:14.948936+0000","last_active":"2024-09-05T07:50:06.467461+0000","last_peered":"2024-09-05T07:50:06.467461+0000","last_clean":"2024-09-05T07:50:06.467461+0000","last_became_active":"2024-09-05T07:49:14.948531+0000","last_became_peered":"2024-09-05T07:49:14.948531+0000","last_unstale":"2024-09-05T07:50:06.467461+0000","last_undegraded":"2024-09-05T07:50:06.467461+0000","last_fullsized":"2024-09-05T07:50:06.467461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:42:22.735935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468230+0000","last_change":"2024-09-05T07:49:14.948848+0000","last_active":"2024-09-05T07:50:06.468230+0000","last_peered":"2024-09-05T07:50:06.468230+0000","last_clean":"2024-09-05T07:50:06.468230+0000","last_became_active":"2024-09-05T07:49:14.948581+0000","last_became_peered":"2024-09-05T07:49:14.948581+0000","last_unstale":"2024-09-05T07:50:06.468230+0000","last_undegraded":"2024-09-05T07:50:06.468230+0000","last_fullsized":"2024-09-05T07:50:06.468230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:53:22.517299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853407+0000","last_change":"2024-09-05T07:49:14.950833+0000","last_active":"2024-09-05T07:50:06.853407+0000","last_peered":"2024-09-05T07:50:06.853407+0000","last_clean":"2024-09-05T07:50:06.853407+0000","last_became_active":"2024-09-05T07:49:14.949905+0000","last_became_peered":"2024-09-05T07:49:14.949905+0000","last_unstale":"2024-09-05T07:50:06.853407+0000","last_undegraded":"2024-09-05T07:50:06.853407+0000","last_fullsized":"2024-09-05T07:50:06.853407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:29:37.999531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464117+0000","last_change":"2024-09-05T07:49:14.957903+0000","last_active":"2024-09-05T07:50:06.464117+0000","last_peered":"2024-09-05T07:50:06.464117+0000","last_clean":"2024-09-05T07:50:06.464117+0000","last_became_active":"2024-09-05T07:49:14.957559+0000","last_became_peered":"2024-09-05T07:49:14.957559+0000","last_unstale":"2024-09-05T07:50:06.464117+0000","last_undegraded":"2024-09-05T07:50:06.464117+0000","last_fullsized":"2024-09-05T07:50:06.464117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:50.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851818+0000","last_change":"2024-09-05T07:49:14.951216+0000","last_active":"2024-09-05T07:50:06.851818+0000","last_peered":"2024-09-05T07:50:06.851818+0000","last_clean":"2024-09-05T07:50:06.851818+0000","last_became_active":"2024-09-05T07:49:14.950518+0000","last_became_peered":"2024-09-05T07:49:14.950518+0000","last_unstale":"2024-09-05T07:50:06.851818+0000","last_undegraded":"2024-09-05T07:50:06.851818+0000","last_fullsized":"2024-09-05T07:50:06.851818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:05.373083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466756+0000","last_change":"2024-09-05T07:49:14.952832+0000","last_active":"2024-09-05T07:50:06.466756+0000","last_peered":"2024-09-05T07:50:06.466756+0000","last_clean":"2024-09-05T07:50:06.466756+0000","last_became_active":"2024-09-05T07:49:14.952470+0000","last_became_peered":"2024-09-05T07:49:14.952470+0000","last_unstale":"2024-09-05T07:50:06.466756+0000","last_undegraded":"2024-09-05T07:50:06.466756+0000","last_fullsized":"2024-09-05T07:50:06.466756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:01.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467806+0000","last_change":"2024-09-05T07:49:14.958144+0000","last_active":"2024-09-05T07:50:06.467806+0000","last_peered":"2024-09-05T07:50:06.467806+0000","last_clean":"2024-09-05T07:50:06.467806+0000","last_became_active":"2024-09-05T07:49:14.957851+0000","last_became_peered":"2024-09-05T07:49:14.957851+0000","last_unstale":"2024-09-05T07:50:06.467806+0000","last_undegraded":"2024-09-05T07:50:06.467806+0000","last_fullsized":"2024-09-05T07:50:06.467806+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:49:37.106955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465116+0000","last_change":"2024-09-05T07:49:14.954599+0000","last_active":"2024-09-05T07:50:06.465116+0000","last_peered":"2024-09-05T07:50:06.465116+0000","last_clean":"2024-09-05T07:50:06.465116+0000","last_became_active":"2024-09-05T07:49:14.954241+0000","last_became_peered":"2024-09-05T07:49:14.954241+0000","last_unstale":"2024-09-05T07:50:06.465116+0000","last_undegraded":"2024-09-05T07:50:06.465116+0000","last_fullsized":"2024-09-05T07:50:06.465116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.657195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851961+0000","last_change":"2024-09-05T07:49:14.948803+0000","last_active":"2024-09-05T07:50:06.851961+0000","last_peered":"2024-09-05T07:50:06.851961+0000","last_clean":"2024-09-05T07:50:06.851961+0000","last_became_active":"2024-09-05T07:49:14.948388+0000","last_became_peered":"2024-09-05T07:49:14.948388+0000","last_unstale":"2024-09-05T07:50:06.851961+0000","last_undegraded":"2024-09-05T07:50:06.851961+0000","last_fullsized":"2024-09-05T07:50:06.851961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.867734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467073+0000","last_change":"2024-09-05T07:49:14.955055+0000","last_active":"2024-09-05T07:50:06.467073+0000","last_peered":"2024-09-05T07:50:06.467073+0000","last_clean":"2024-09-05T07:50:06.467073+0000","last_became_active":"2024-09-05T07:49:14.954758+0000","last_became_peered":"2024-09-05T07:49:14.954758+0000","last_unstale":"2024-09-05T07:50:06.467073+0000","last_undegraded":"2024-09-05T07:50:06.467073+0000","last_fullsized":"2024-09-05T07:50:06.467073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:52.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853283+0000","last_change":"2024-09-05T07:49:14.947590+0000","last_active":"2024-09-05T07:50:06.853283+0000","last_peered":"2024-09-05T07:50:06.853283+0000","last_clean":"2024-09-05T07:50:06.853283+0000","last_became_active":"2024-09-05T07:49:14.947097+0000","last_became_peered":"2024-09-05T07:49:14.947097+0000","last_unstale":"2024-09-05T07:50:06.853283+0000","last_undegraded":"2024-09-05T07:50:06.853283+0000","last_fullsized":"2024-09-05T07:50:06.853283+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:01.318442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464577+0000","last_change":"2024-09-05T07:49:14.947195+0000","last_active":"2024-09-05T07:50:06.464577+0000","last_peered":"2024-09-05T07:50:06.464577+0000","last_clean":"2024-09-05T07:50:06.464577+0000","last_became_active":"2024-09-05T07:49:14.946874+0000","last_became_peered":"2024-09-05T07:49:14.946874+0000","last_unstale":"2024-09-05T07:50:06.464577+0000","last_undegraded":"2024-09-05T07:50:06.464577+0000","last_fullsized":"2024-09-05T07:50:06.464577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:08.582375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467303+0000","last_change":"2024-09-05T07:49:14.948203+0000","last_active":"2024-09-05T07:50:06.467303+0000","last_peered":"2024-09-05T07:50:06.467303+0000","last_clean":"2024-09-05T07:50:06.467303+0000","last_became_active":"2024-09-05T07:49:14.947748+0000","last_became_peered":"2024-09-05T07:49:14.947748+0000","last_unstale":"2024-09-05T07:50:06.467303+0000","last_undegraded":"2024-09-05T07:50:06.467303+0000","last_fullsized":"2024-09-05T07:50:06.467303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468013+0000","last_change":"2024-09-05T07:49:14.954176+0000","last_active":"2024-09-05T07:50:06.468013+0000","last_peered":"2024-09-05T07:50:06.468013+0000","last_clean":"2024-09-05T07:50:06.468013+0000","last_became_active":"2024-09-05T07:49:14.952078+0000","last_became_peered":"2024-09-05T07:49:14.952078+0000","last_unstale":"2024-09-05T07:50:06.468013+0000","last_undegraded":"2024-09-05T07:50:06.468013+0000","last_fullsized":"2024-09-05T07:50:06.468013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:38:10.311444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464444+0000","last_change":"2024-09-05T07:49:14.958096+0000","last_active":"2024-09-05T07:50:06.464444+0000","last_peered":"2024-09-05T07:50:06.464444+0000","last_clean":"2024-09-05T07:50:06.464444+0000","last_became_active":"2024-09-05T07:49:14.957219+0000","last_became_peered":"2024-09-05T07:49:14.957219+0000","last_unstale":"2024-09-05T07:50:06.464444+0000","last_undegraded":"2024-09-05T07:50:06.464444+0000","last_fullsized":"2024-09-05T07:50:06.464444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:03:20.623475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464843+0000","last_change":"2024-09-05T07:49:14.950844+0000","last_active":"2024-09-05T07:50:06.464843+0000","last_peered":"2024-09-05T07:50:06.464843+0000","last_clean":"2024-09-05T07:50:06.464843+0000","last_became_active":"2024-09-05T07:49:14.950423+0000","last_became_peered":"2024-09-05T07:49:14.950423+0000","last_unstale":"2024-09-05T07:50:06.464843+0000","last_undegraded":"2024-09-05T07:50:06.464843+0000","last_fullsized":"2024-09-05T07:50:06.464843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:53.633531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465315+0000","last_change":"2024-09-05T07:49:14.951525+0000","last_active":"2024-09-05T07:50:06.465315+0000","last_peered":"2024-09-05T07:50:06.465315+0000","last_clean":"2024-09-05T07:50:06.465315+0000","last_became_active":"2024-09-05T07:49:14.951007+0000","last_became_peered":"2024-09-05T07:49:14.951007+0000","last_unstale":"2024-09-05T07:50:06.465315+0000","last_undegraded":"2024-09-05T07:50:06.465315+0000","last_fullsized":"2024-09-05T07:50:06.465315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:18:17.895969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462895+0000","last_change":"2024-09-05T07:49:14.968131+0000","last_active":"2024-09-05T07:50:06.462895+0000","last_peered":"2024-09-05T07:50:06.462895+0000","last_clean":"2024-09-05T07:50:06.462895+0000","last_became_active":"2024-09-05T07:49:14.967843+0000","last_became_peered":"2024-09-05T07:49:14.967843+0000","last_unstale":"2024-09-05T07:50:06.462895+0000","last_undegraded":"2024-09-05T07:50:06.462895+0000","last_fullsized":"2024-09-05T07:50:06.462895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:10.271731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464312+0000","last_change":"2024-09-05T07:49:14.944475+0000","last_active":"2024-09-05T07:50:06.464312+0000","last_peered":"2024-09-05T07:50:06.464312+0000","last_clean":"2024-09-05T07:50:06.464312+0000","last_became_active":"2024-09-05T07:49:14.944114+0000","last_became_peered":"2024-09-05T07:49:14.944114+0000","last_unstale":"2024-09-05T07:50:06.464312+0000","last_undegraded":"2024-09-05T07:50:06.464312+0000","last_fullsized":"2024-09-05T07:50:06.464312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:51.097613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464662+0000","last_change":"2024-09-05T07:49:14.955374+0000","last_active":"2024-09-05T07:50:06.464662+0000","last_peered":"2024-09-05T07:50:06.464662+0000","last_clean":"2024-09-05T07:50:06.464662+0000","last_became_active":"2024-09-05T07:49:14.955076+0000","last_became_peered":"2024-09-05T07:49:14.955076+0000","last_unstale":"2024-09-05T07:50:06.464662+0000","last_undegraded":"2024-09-05T07:50:06.464662+0000","last_fullsized":"2024-09-05T07:50:06.464662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:48.784069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464603+0000","last_change":"2024-09-05T07:49:14.957865+0000","last_active":"2024-09-05T07:50:06.464603+0000","last_peered":"2024-09-05T07:50:06.464603+0000","last_clean":"2024-09-05T07:50:06.464603+0000","last_became_active":"2024-09-05T07:49:14.957485+0000","last_became_peered":"2024-09-05T07:49:14.957485+0000","last_unstale":"2024-09-05T07:50:06.464603+0000","last_undegraded":"2024-09-05T07:50:06.464603+0000","last_fullsized":"2024-09-05T07:50:06.464603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:18.126600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467914+0000","last_change":"2024-09-05T07:49:14.957899+0000","last_active":"2024-09-05T07:50:06.467914+0000","last_peered":"2024-09-05T07:50:06.467914+0000","last_clean":"2024-09-05T07:50:06.467914+0000","last_became_active":"2024-09-05T07:49:14.957564+0000","last_became_peered":"2024-09-05T07:49:14.957564+0000","last_unstale":"2024-09-05T07:50:06.467914+0000","last_undegraded":"2024-09-05T07:50:06.467914+0000","last_fullsized":"2024-09-05T07:50:06.467914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:31.162232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467510+0000","last_change":"2024-09-05T07:49:14.958238+0000","last_active":"2024-09-05T07:50:06.467510+0000","last_peered":"2024-09-05T07:50:06.467510+0000","last_clean":"2024-09-05T07:50:06.467510+0000","last_became_active":"2024-09-05T07:49:14.957883+0000","last_became_peered":"2024-09-05T07:49:14.957883+0000","last_unstale":"2024-09-05T07:50:06.467510+0000","last_undegraded":"2024-09-05T07:50:06.467510+0000","last_fullsized":"2024-09-05T07:50:06.467510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:31:42.388350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468033+0000","last_change":"2024-09-05T07:49:14.965003+0000","last_active":"2024-09-05T07:50:06.468033+0000","last_peered":"2024-09-05T07:50:06.468033+0000","last_clean":"2024-09-05T07:50:06.468033+0000","last_became_active":"2024-09-05T07:49:14.964709+0000","last_became_peered":"2024-09-05T07:49:14.964709+0000","last_unstale":"2024-09-05T07:50:06.468033+0000","last_undegraded":"2024-09-05T07:50:06.468033+0000","last_fullsized":"2024-09-05T07:50:06.468033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:06.050894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463046+0000","last_change":"2024-09-05T07:49:14.946355+0000","last_active":"2024-09-05T07:50:06.463046+0000","last_peered":"2024-09-05T07:50:06.463046+0000","last_clean":"2024-09-05T07:50:06.463046+0000","last_became_active":"2024-09-05T07:49:14.946060+0000","last_became_peered":"2024-09-05T07:49:14.946060+0000","last_unstale":"2024-09-05T07:50:06.463046+0000","last_undegraded":"2024-09-05T07:50:06.463046+0000","last_fullsized":"2024-09-05T07:50:06.463046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:31.578598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465922+0000","last_change":"2024-09-05T07:49:14.947815+0000","last_active":"2024-09-05T07:50:06.465922+0000","last_peered":"2024-09-05T07:50:06.465922+0000","last_clean":"2024-09-05T07:50:06.465922+0000","last_became_active":"2024-09-05T07:49:14.947470+0000","last_became_peered":"2024-09-05T07:49:14.947470+0000","last_unstale":"2024-09-05T07:50:06.465922+0000","last_undegraded":"2024-09-05T07:50:06.465922+0000","last_fullsized":"2024-09-05T07:50:06.465922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:31.312585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464039+0000","last_change":"2024-09-05T07:49:14.951838+0000","last_active":"2024-09-05T07:50:06.464039+0000","last_peered":"2024-09-05T07:50:06.464039+0000","last_clean":"2024-09-05T07:50:06.464039+0000","last_became_active":"2024-09-05T07:49:14.951505+0000","last_became_peered":"2024-09-05T07:49:14.951505+0000","last_unstale":"2024-09-05T07:50:06.464039+0000","last_undegraded":"2024-09-05T07:50:06.464039+0000","last_fullsized":"2024-09-05T07:50:06.464039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:51:03.739607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.471150+0000","last_change":"2024-09-05T07:50:06.471150+0000","last_active":"2024-09-05T07:50:06.471150+0000","last_peered":"2024-09-05T07:50:06.471150+0000","last_clean":"2024-09-05T07:50:06.471150+0000","last_became_active":"2024-09-05T07:50:06.470817+0000","last_became_peered":"2024-09-05T07:50:06.470817+0000","last_unstale":"2024-09-05T07:50:06.471150+0000","last_undegraded":"2024-09-05T07:50:06.471150+0000","last_fullsized":"2024-09-05T07:50:06.471150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:59.671916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.470260+0000","last_change":"2024-09-05T07:50:06.470260+0000","last_active":"2024-09-05T07:50:06.470260+0000","last_peered":"2024-09-05T07:50:06.470260+0000","last_clean":"2024-09-05T07:50:06.470260+0000","last_became_active":"2024-09-05T07:50:06.469831+0000","last_became_peered":"2024-09-05T07:50:06.469831+0000","last_unstale":"2024-09-05T07:50:06.470260+0000","last_undegraded":"2024-09-05T07:50:06.470260+0000","last_fullsized":"2024-09-05T07:50:06.470260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:57:10.932375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462254+0000","last_change":"2024-09-05T07:49:14.949907+0000","last_active":"2024-09-05T07:50:06.462254+0000","last_peered":"2024-09-05T07:50:06.462254+0000","last_clean":"2024-09-05T07:50:06.462254+0000","last_became_active":"2024-09-05T07:49:14.949583+0000","last_became_peered":"2024-09-05T07:49:14.949583+0000","last_unstale":"2024-09-05T07:50:06.462254+0000","last_undegraded":"2024-09-05T07:50:06.462254+0000","last_fullsized":"2024-09-05T07:50:06.462254+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:42:38.342496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464051+0000","last_change":"2024-09-05T07:49:14.943501+0000","last_active":"2024-09-05T07:50:06.464051+0000","last_peered":"2024-09-05T07:50:06.464051+0000","last_clean":"2024-09-05T07:50:06.464051+0000","last_became_active":"2024-09-05T07:49:14.943184+0000","last_became_peered":"2024-09-05T07:49:14.943184+0000","last_unstale":"2024-09-05T07:50:06.464051+0000","last_undegraded":"2024-09-05T07:50:06.464051+0000","last_fullsized":"2024-09-05T07:50:06.464051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:11:30.840749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463942+0000","last_change":"2024-09-05T07:49:14.947161+0000","last_active":"2024-09-05T07:50:06.463942+0000","last_peered":"2024-09-05T07:50:06.463942+0000","last_clean":"2024-09-05T07:50:06.463942+0000","last_became_active":"2024-09-05T07:49:14.946830+0000","last_became_peered":"2024-09-05T07:49:14.946830+0000","last_unstale":"2024-09-05T07:50:06.463942+0000","last_undegraded":"2024-09-05T07:50:06.463942+0000","last_fullsized":"2024-09-05T07:50:06.463942+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:24:03.193771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:23.442266+0000","last_change":"2024-09-05T07:49:12.623481+0000","last_active":"2024-09-05T07:50:23.442266+0000","last_peered":"2024-09-05T07:50:23.442266+0000","last_clean":"2024-09-05T07:50:23.442266+0000","last_became_active":"2024-09-05T07:49:12.623138+0000","last_became_peered":"2024-09-05T07:49:12.623138+0000","last_unstale":"2024-09-05T07:50:23.442266+0000","last_undegraded":"2024-09-05T07:50:23.442266+0000","last_fullsized":"2024-09-05T07:50:23.442266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:05:20.912935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.471612+0000","last_change":"2024-09-05T07:50:06.471612+0000","last_active":"2024-09-05T07:50:06.471612+0000","last_peered":"2024-09-05T07:50:06.471612+0000","last_clean":"2024-09-05T07:50:06.471612+0000","last_became_active":"2024-09-05T07:50:06.471230+0000","last_became_peered":"2024-09-05T07:50:06.471230+0000","last_unstale":"2024-09-05T07:50:06.471612+0000","last_undegraded":"2024-09-05T07:50:06.471612+0000","last_fullsized":"2024-09-05T07:50:06.471612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:03.405306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851945+0000","last_change":"2024-09-05T07:49:12.622424+0000","last_active":"2024-09-05T07:50:06.851945+0000","last_peered":"2024-09-05T07:50:06.851945+0000","last_clean":"2024-09-05T07:50:06.851945+0000","last_became_active":"2024-09-05T07:49:12.622081+0000","last_became_peered":"2024-09-05T07:49:12.622081+0000","last_unstale":"2024-09-05T07:50:06.851945+0000","last_undegraded":"2024-09-05T07:50:06.851945+0000","last_fullsized":"2024-09-05T07:50:06.851945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:12.531564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464179+0000","last_change":"2024-09-05T07:49:12.619623+0000","last_active":"2024-09-05T07:50:06.464179+0000","last_peered":"2024-09-05T07:50:06.464179+0000","last_clean":"2024-09-05T07:50:06.464179+0000","last_became_active":"2024-09-05T07:49:12.618756+0000","last_became_peered":"2024-09-05T07:49:12.618756+0000","last_unstale":"2024-09-05T07:50:06.464179+0000","last_undegraded":"2024-09-05T07:50:06.464179+0000","last_fullsized":"2024-09-05T07:50:06.464179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:57:55.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467899+0000","last_change":"2024-09-05T07:49:14.966157+0000","last_active":"2024-09-05T07:50:06.467899+0000","last_peered":"2024-09-05T07:50:06.467899+0000","last_clean":"2024-09-05T07:50:06.467899+0000","last_became_active":"2024-09-05T07:49:14.963557+0000","last_became_peered":"2024-09-05T07:49:14.963557+0000","last_unstale":"2024-09-05T07:50:06.467899+0000","last_undegraded":"2024-09-05T07:50:06.467899+0000","last_fullsized":"2024-09-05T07:50:06.467899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:17.900388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468488+0000","last_change":"2024-09-05T07:49:12.620531+0000","last_active":"2024-09-05T07:50:06.468488+0000","last_peered":"2024-09-05T07:50:06.468488+0000","last_clean":"2024-09-05T07:50:06.468488+0000","last_became_active":"2024-09-05T07:49:12.620227+0000","last_became_peered":"2024-09-05T07:49:12.620227+0000","last_unstale":"2024-09-05T07:50:06.468488+0000","last_undegraded":"2024-09-05T07:50:06.468488+0000","last_fullsized":"2024-09-05T07:50:06.468488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:43.694290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464886+0000","last_change":"2024-09-05T07:49:14.964372+0000","last_active":"2024-09-05T07:50:06.464886+0000","last_peered":"2024-09-05T07:50:06.464886+0000","last_clean":"2024-09-05T07:50:06.464886+0000","last_became_active":"2024-09-05T07:49:14.964017+0000","last_became_peered":"2024-09-05T07:49:14.964017+0000","last_unstale":"2024-09-05T07:50:06.464886+0000","last_undegraded":"2024-09-05T07:50:06.464886+0000","last_fullsized":"2024-09-05T07:50:06.464886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:21:05.059035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:26.445433+0000","last_change":"2024-09-05T07:49:12.617764+0000","last_active":"2024-09-05T07:50:26.445433+0000","last_peered":"2024-09-05T07:50:26.445433+0000","last_clean":"2024-09-05T07:50:26.445433+0000","last_became_active":"2024-09-05T07:49:12.617362+0000","last_became_peered":"2024-09-05T07:49:12.617362+0000","last_unstale":"2024-09-05T07:50:26.445433+0000","last_undegraded":"2024-09-05T07:50:26.445433+0000","last_fullsized":"2024-09-05T07:50:26.445433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:27.291110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465000+0000","last_change":"2024-09-05T07:49:14.946462+0000","last_active":"2024-09-05T07:50:06.465000+0000","last_peered":"2024-09-05T07:50:06.465000+0000","last_clean":"2024-09-05T07:50:06.465000+0000","last_became_active":"2024-09-05T07:49:14.946148+0000","last_became_peered":"2024-09-05T07:49:14.946148+0000","last_unstale":"2024-09-05T07:50:06.465000+0000","last_undegraded":"2024-09-05T07:50:06.465000+0000","last_fullsized":"2024-09-05T07:50:06.465000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:58.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466962+0000","last_change":"2024-09-05T07:49:12.624126+0000","last_active":"2024-09-05T07:50:06.466962+0000","last_peered":"2024-09-05T07:50:06.466962+0000","last_clean":"2024-09-05T07:50:06.466962+0000","last_became_active":"2024-09-05T07:49:12.623552+0000","last_became_peered":"2024-09-05T07:49:12.623552+0000","last_unstale":"2024-09-05T07:50:06.466962+0000","last_undegraded":"2024-09-05T07:50:06.466962+0000","last_fullsized":"2024-09-05T07:50:06.466962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:32.068841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467362+0000","last_change":"2024-09-05T07:49:14.953564+0000","last_active":"2024-09-05T07:50:06.467362+0000","last_peered":"2024-09-05T07:50:06.467362+0000","last_clean":"2024-09-05T07:50:06.467362+0000","last_became_active":"2024-09-05T07:49:14.953257+0000","last_became_peered":"2024-09-05T07:49:14.953257+0000","last_unstale":"2024-09-05T07:50:06.467362+0000","last_undegraded":"2024-09-05T07:50:06.467362+0000","last_fullsized":"2024-09-05T07:50:06.467362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:46.140705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.469097+0000","last_change":"2024-09-05T07:49:12.923484+0000","last_active":"2024-09-05T07:50:06.469097+0000","last_peered":"2024-09-05T07:50:06.469097+0000","last_clean":"2024-09-05T07:50:06.469097+0000","last_became_active":"2024-09-05T07:49:12.923039+0000","last_became_peered":"2024-09-05T07:49:12.923039+0000","last_unstale":"2024-09-05T07:50:06.469097+0000","last_undegraded":"2024-09-05T07:50:06.469097+0000","last_fullsized":"2024-09-05T07:50:06.469097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:25:32.918343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464619+0000","last_change":"2024-09-05T07:49:14.946368+0000","last_active":"2024-09-05T07:50:06.464619+0000","last_peered":"2024-09-05T07:50:06.464619+0000","last_clean":"2024-09-05T07:50:06.464619+0000","last_became_active":"2024-09-05T07:49:14.946023+0000","last_became_peered":"2024-09-05T07:49:14.946023+0000","last_unstale":"2024-09-05T07:50:06.464619+0000","last_undegraded":"2024-09-05T07:50:06.464619+0000","last_fullsized":"2024-09-05T07:50:06.464619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:27.579086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":179,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:26.445433+0000","last_change":"2024-09-05T07:49:12.623923+0000","last_active":"2024-09-05T07:50:26.445433+0000","last_peered":"2024-09-05T07:50:26.445433+0000","last_clean":"2024-09-05T07:50:26.445433+0000","last_became_active":"2024-09-05T07:49:12.623559+0000","last_became_peered":"2024-09-05T07:49:12.623559+0000","last_unstale":"2024-09-05T07:50:26.445433+0000","last_undegraded":"2024-09-05T07:50:26.445433+0000","last_fullsized":"2024-09-05T07:50:26.445433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:08:10.479958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465701+0000","last_change":"2024-09-05T07:49:14.953936+0000","last_active":"2024-09-05T07:50:06.465701+0000","last_peered":"2024-09-05T07:50:06.465701+0000","last_clean":"2024-09-05T07:50:06.465701+0000","last_became_active":"2024-09-05T07:49:14.952830+0000","last_became_peered":"2024-09-05T07:49:14.952830+0000","last_unstale":"2024-09-05T07:50:06.465701+0000","last_undegraded":"2024-09-05T07:50:06.465701+0000","last_fullsized":"2024-09-05T07:50:06.465701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:26.907025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.462485+0000","last_change":"2024-09-05T07:49:12.623299+0000","last_active":"2024-09-05T07:50:06.462485+0000","last_peered":"2024-09-05T07:50:06.462485+0000","last_clean":"2024-09-05T07:50:06.462485+0000","last_became_active":"2024-09-05T07:49:12.622942+0000","last_became_peered":"2024-09-05T07:49:12.622942+0000","last_unstale":"2024-09-05T07:50:06.462485+0000","last_undegraded":"2024-09-05T07:50:06.462485+0000","last_fullsized":"2024-09-05T07:50:06.462485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:59:07.846104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464022+0000","last_change":"2024-09-05T07:49:14.959269+0000","last_active":"2024-09-05T07:50:06.464022+0000","last_peered":"2024-09-05T07:50:06.464022+0000","last_clean":"2024-09-05T07:50:06.464022+0000","last_became_active":"2024-09-05T07:49:14.956838+0000","last_became_peered":"2024-09-05T07:49:14.956838+0000","last_unstale":"2024-09-05T07:50:06.464022+0000","last_undegraded":"2024-09-05T07:50:06.464022+0000","last_fullsized":"2024-09-05T07:50:06.464022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:40.047519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468388+0000","last_change":"2024-09-05T07:49:12.618068+0000","last_active":"2024-09-05T07:50:06.468388+0000","last_peered":"2024-09-05T07:50:06.468388+0000","last_clean":"2024-09-05T07:50:06.468388+0000","last_became_active":"2024-09-05T07:49:12.617125+0000","last_became_peered":"2024-09-05T07:49:12.617125+0000","last_unstale":"2024-09-05T07:50:06.468388+0000","last_undegraded":"2024-09-05T07:50:06.468388+0000","last_fullsized":"2024-09-05T07:50:06.468388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:39:50.999342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467220+0000","last_change":"2024-09-05T07:49:14.956131+0000","last_active":"2024-09-05T07:50:06.467220+0000","last_peered":"2024-09-05T07:50:06.467220+0000","last_clean":"2024-09-05T07:50:06.467220+0000","last_became_active":"2024-09-05T07:49:14.955817+0000","last_became_peered":"2024-09-05T07:49:14.955817+0000","last_unstale":"2024-09-05T07:50:06.467220+0000","last_undegraded":"2024-09-05T07:50:06.467220+0000","last_fullsized":"2024-09-05T07:50:06.467220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:14.800599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:24.443190+0000","last_change":"2024-09-05T07:49:12.620990+0000","last_active":"2024-09-05T07:50:24.443190+0000","last_peered":"2024-09-05T07:50:24.443190+0000","last_clean":"2024-09-05T07:50:24.443190+0000","last_became_active":"2024-09-05T07:49:12.620571+0000","last_became_peered":"2024-09-05T07:49:12.620571+0000","last_unstale":"2024-09-05T07:50:24.443190+0000","last_undegraded":"2024-09-05T07:50:24.443190+0000","last_fullsized":"2024-09-05T07:50:24.443190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:01.006805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466706+0000","last_change":"2024-09-05T07:49:14.954588+0000","last_active":"2024-09-05T07:50:06.466706+0000","last_peered":"2024-09-05T07:50:06.466706+0000","last_clean":"2024-09-05T07:50:06.466706+0000","last_became_active":"2024-09-05T07:49:14.954252+0000","last_became_peered":"2024-09-05T07:49:14.954252+0000","last_unstale":"2024-09-05T07:50:06.466706+0000","last_undegraded":"2024-09-05T07:50:06.466706+0000","last_fullsized":"2024-09-05T07:50:06.466706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:31.208385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464720+0000","last_change":"2024-09-05T07:49:12.922771+0000","last_active":"2024-09-05T07:50:06.464720+0000","last_peered":"2024-09-05T07:50:06.464720+0000","last_clean":"2024-09-05T07:50:06.464720+0000","last_became_active":"2024-09-05T07:49:12.922377+0000","last_became_peered":"2024-09-05T07:49:12.922377+0000","last_unstale":"2024-09-05T07:50:06.464720+0000","last_undegraded":"2024-09-05T07:50:06.464720+0000","last_fullsized":"2024-09-05T07:50:06.464720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:54.376164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852870+0000","last_change":"2024-09-05T07:50:06.852870+0000","last_active":"2024-09-05T07:50:06.852870+0000","last_peered":"2024-09-05T07:50:06.852870+0000","last_clean":"2024-09-05T07:50:06.852870+0000","last_became_active":"2024-09-05T07:50:06.852431+0000","last_became_peered":"2024-09-05T07:50:06.852431+0000","last_unstale":"2024-09-05T07:50:06.852870+0000","last_undegraded":"2024-09-05T07:50:06.852870+0000","last_fullsized":"2024-09-05T07:50:06.852870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:14:40.779070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465427+0000","last_change":"2024-09-05T07:49:12.623690+0000","last_active":"2024-09-05T07:50:06.465427+0000","last_peered":"2024-09-05T07:50:06.465427+0000","last_clean":"2024-09-05T07:50:06.465427+0000","last_became_active":"2024-09-05T07:49:12.623315+0000","last_became_peered":"2024-09-05T07:49:12.623315+0000","last_unstale":"2024-09-05T07:50:06.465427+0000","last_undegraded":"2024-09-05T07:50:06.465427+0000","last_fullsized":"2024-09-05T07:50:06.465427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:01.293175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464243+0000","last_change":"2024-09-05T07:49:14.943190+0000","last_active":"2024-09-05T07:50:06.464243+0000","last_peered":"2024-09-05T07:50:06.464243+0000","last_clean":"2024-09-05T07:50:06.464243+0000","last_became_active":"2024-09-05T07:49:14.942863+0000","last_became_peered":"2024-09-05T07:49:14.942863+0000","last_unstale":"2024-09-05T07:50:06.464243+0000","last_undegraded":"2024-09-05T07:50:06.464243+0000","last_fullsized":"2024-09-05T07:50:06.464243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:54.401096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465155+0000","last_change":"2024-09-05T07:49:12.623328+0000","last_active":"2024-09-05T07:50:06.465155+0000","last_peered":"2024-09-05T07:50:06.465155+0000","last_clean":"2024-09-05T07:50:06.465155+0000","last_became_active":"2024-09-05T07:49:12.622993+0000","last_became_peered":"2024-09-05T07:49:12.622993+0000","last_unstale":"2024-09-05T07:50:06.465155+0000","last_undegraded":"2024-09-05T07:50:06.465155+0000","last_fullsized":"2024-09-05T07:50:06.465155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:11:27.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467243+0000","last_change":"2024-09-05T07:49:14.951250+0000","last_active":"2024-09-05T07:50:06.467243+0000","last_peered":"2024-09-05T07:50:06.467243+0000","last_clean":"2024-09-05T07:50:06.467243+0000","last_became_active":"2024-09-05T07:49:14.950834+0000","last_became_peered":"2024-09-05T07:49:14.950834+0000","last_unstale":"2024-09-05T07:50:06.467243+0000","last_undegraded":"2024-09-05T07:50:06.467243+0000","last_fullsized":"2024-09-05T07:50:06.467243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:42.992517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.469147+0000","last_change":"2024-09-05T07:49:12.620555+0000","last_active":"2024-09-05T07:50:06.469147+0000","last_peered":"2024-09-05T07:50:06.469147+0000","last_clean":"2024-09-05T07:50:06.469147+0000","last_became_active":"2024-09-05T07:49:12.619847+0000","last_became_peered":"2024-09-05T07:49:12.619847+0000","last_unstale":"2024-09-05T07:50:06.469147+0000","last_undegraded":"2024-09-05T07:50:06.469147+0000","last_fullsized":"2024-09-05T07:50:06.469147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:18:59.833342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466957+0000","last_change":"2024-09-05T07:49:14.952173+0000","last_active":"2024-09-05T07:50:06.466957+0000","last_peered":"2024-09-05T07:50:06.466957+0000","last_clean":"2024-09-05T07:50:06.466957+0000","last_became_active":"2024-09-05T07:49:14.951848+0000","last_became_peered":"2024-09-05T07:49:14.951848+0000","last_unstale":"2024-09-05T07:50:06.466957+0000","last_undegraded":"2024-09-05T07:50:06.466957+0000","last_fullsized":"2024-09-05T07:50:06.466957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:26.446361+0000","last_change":"2024-09-05T07:49:12.923318+0000","last_active":"2024-09-05T07:50:26.446361+0000","last_peered":"2024-09-05T07:50:26.446361+0000","last_clean":"2024-09-05T07:50:26.446361+0000","last_became_active":"2024-09-05T07:49:12.922965+0000","last_became_peered":"2024-09-05T07:49:12.922965+0000","last_unstale":"2024-09-05T07:50:26.446361+0000","last_undegraded":"2024-09-05T07:50:26.446361+0000","last_fullsized":"2024-09-05T07:50:26.446361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:19.576198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467174+0000","last_change":"2024-09-05T07:49:14.950067+0000","last_active":"2024-09-05T07:50:06.467174+0000","last_peered":"2024-09-05T07:50:06.467174+0000","last_clean":"2024-09-05T07:50:06.467174+0000","last_became_active":"2024-09-05T07:49:14.949580+0000","last_became_peered":"2024-09-05T07:49:14.949580+0000","last_unstale":"2024-09-05T07:50:06.467174+0000","last_undegraded":"2024-09-05T07:50:06.467174+0000","last_fullsized":"2024-09-05T07:50:06.467174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:08.754476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467135+0000","last_change":"2024-09-05T07:47:54.520597+0000","last_active":"2024-09-05T07:50:06.467135+0000","last_peered":"2024-09-05T07:50:06.467135+0000","last_clean":"2024-09-05T07:50:06.467135+0000","last_became_active":"2024-09-05T07:47:54.520187+0000","last_became_peered":"2024-09-05T07:47:54.520187+0000","last_unstale":"2024-09-05T07:50:06.467135+0000","last_undegraded":"2024-09-05T07:50:06.467135+0000","last_fullsized":"2024-09-05T07:50:06.467135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:44:23.832394+0000","last_clean_scrub_stamp":"2024-09-05T07:44:23.832394+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:19.382482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853163+0000","last_change":"2024-09-05T07:49:12.618142+0000","last_active":"2024-09-05T07:50:06.853163+0000","last_peered":"2024-09-05T07:50:06.853163+0000","last_clean":"2024-09-05T07:50:06.853163+0000","last_became_active":"2024-09-05T07:49:12.617799+0000","last_became_peered":"2024-09-05T07:49:12.617799+0000","last_unstale":"2024-09-05T07:50:06.853163+0000","last_undegraded":"2024-09-05T07:50:06.853163+0000","last_fullsized":"2024-09-05T07:50:06.853163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:34:55.843402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467734+0000","last_change":"2024-09-05T07:49:14.962066+0000","last_active":"2024-09-05T07:50:06.467734+0000","last_peered":"2024-09-05T07:50:06.467734+0000","last_clean":"2024-09-05T07:50:06.467734+0000","last_became_active":"2024-09-05T07:49:14.952793+0000","last_became_peered":"2024-09-05T07:49:14.952793+0000","last_unstale":"2024-09-05T07:50:06.467734+0000","last_undegraded":"2024-09-05T07:50:06.467734+0000","last_fullsized":"2024-09-05T07:50:06.467734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:53.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.466944+0000","last_change":"2024-09-05T07:49:12.624350+0000","last_active":"2024-09-05T07:50:06.466944+0000","last_peered":"2024-09-05T07:50:06.466944+0000","last_clean":"2024-09-05T07:50:06.466944+0000","last_became_active":"2024-09-05T07:49:12.623907+0000","last_became_peered":"2024-09-05T07:49:12.623907+0000","last_unstale":"2024-09-05T07:50:06.466944+0000","last_undegraded":"2024-09-05T07:50:06.466944+0000","last_fullsized":"2024-09-05T07:50:06.466944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.663789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464050+0000","last_change":"2024-09-05T07:49:14.953372+0000","last_active":"2024-09-05T07:50:06.464050+0000","last_peered":"2024-09-05T07:50:06.464050+0000","last_clean":"2024-09-05T07:50:06.464050+0000","last_became_active":"2024-09-05T07:49:14.952986+0000","last_became_peered":"2024-09-05T07:49:14.952986+0000","last_unstale":"2024-09-05T07:50:06.464050+0000","last_undegraded":"2024-09-05T07:50:06.464050+0000","last_fullsized":"2024-09-05T07:50:06.464050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:01:55.338289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:26.445466+0000","last_change":"2024-09-05T07:49:12.923463+0000","last_active":"2024-09-05T07:50:26.445466+0000","last_peered":"2024-09-05T07:50:26.445466+0000","last_clean":"2024-09-05T07:50:26.445466+0000","last_became_active":"2024-09-05T07:49:12.923105+0000","last_became_peered":"2024-09-05T07:49:12.923105+0000","last_unstale":"2024-09-05T07:50:26.445466+0000","last_undegraded":"2024-09-05T07:50:26.445466+0000","last_fullsized":"2024-09-05T07:50:26.445466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:25:21.795954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852962+0000","last_change":"2024-09-05T07:50:06.852962+0000","last_active":"2024-09-05T07:50:06.852962+0000","last_peered":"2024-09-05T07:50:06.852962+0000","last_clean":"2024-09-05T07:50:06.852962+0000","last_became_active":"2024-09-05T07:50:06.852616+0000","last_became_peered":"2024-09-05T07:50:06.852616+0000","last_unstale":"2024-09-05T07:50:06.852962+0000","last_undegraded":"2024-09-05T07:50:06.852962+0000","last_fullsized":"2024-09-05T07:50:06.852962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:56:06.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":90,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:26.446022+0000","last_change":"2024-09-05T07:49:12.618510+0000","last_active":"2024-09-05T07:50:26.446022+0000","last_peered":"2024-09-05T07:50:26.446022+0000","last_clean":"2024-09-05T07:50:26.446022+0000","last_became_active":"2024-09-05T07:49:12.618160+0000","last_became_peered":"2024-09-05T07:49:12.618160+0000","last_unstale":"2024-09-05T07:50:26.446022+0000","last_undegraded":"2024-09-05T07:50:26.446022+0000","last_fullsized":"2024-09-05T07:50:26.446022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:52:12.432287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.852130+0000","last_change":"2024-09-05T07:49:14.953989+0000","last_active":"2024-09-05T07:50:06.852130+0000","last_peered":"2024-09-05T07:50:06.852130+0000","last_clean":"2024-09-05T07:50:06.852130+0000","last_became_active":"2024-09-05T07:49:14.953651+0000","last_became_peered":"2024-09-05T07:49:14.953651+0000","last_unstale":"2024-09-05T07:50:06.852130+0000","last_undegraded":"2024-09-05T07:50:06.852130+0000","last_fullsized":"2024-09-05T07:50:06.852130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:36.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465072+0000","last_change":"2024-09-05T07:49:12.923661+0000","last_active":"2024-09-05T07:50:06.465072+0000","last_peered":"2024-09-05T07:50:06.465072+0000","last_clean":"2024-09-05T07:50:06.465072+0000","last_became_active":"2024-09-05T07:49:12.923273+0000","last_became_peered":"2024-09-05T07:49:12.923273+0000","last_unstale":"2024-09-05T07:50:06.465072+0000","last_undegraded":"2024-09-05T07:50:06.465072+0000","last_fullsized":"2024-09-05T07:50:06.465072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:08.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.851984+0000","last_change":"2024-09-05T07:49:14.964797+0000","last_active":"2024-09-05T07:50:06.851984+0000","last_peered":"2024-09-05T07:50:06.851984+0000","last_clean":"2024-09-05T07:50:06.851984+0000","last_became_active":"2024-09-05T07:49:14.964411+0000","last_became_peered":"2024-09-05T07:49:14.964411+0000","last_unstale":"2024-09-05T07:50:06.851984+0000","last_undegraded":"2024-09-05T07:50:06.851984+0000","last_fullsized":"2024-09-05T07:50:06.851984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:55:37.150270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465826+0000","last_change":"2024-09-05T07:49:12.924896+0000","last_active":"2024-09-05T07:50:06.465826+0000","last_peered":"2024-09-05T07:50:06.465826+0000","last_clean":"2024-09-05T07:50:06.465826+0000","last_became_active":"2024-09-05T07:49:12.924556+0000","last_became_peered":"2024-09-05T07:49:12.924556+0000","last_unstale":"2024-09-05T07:50:06.465826+0000","last_undegraded":"2024-09-05T07:50:06.465826+0000","last_fullsized":"2024-09-05T07:50:06.465826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:02:37.433963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464155+0000","last_change":"2024-09-05T07:49:14.953635+0000","last_active":"2024-09-05T07:50:06.464155+0000","last_peered":"2024-09-05T07:50:06.464155+0000","last_clean":"2024-09-05T07:50:06.464155+0000","last_became_active":"2024-09-05T07:49:14.950967+0000","last_became_peered":"2024-09-05T07:49:14.950967+0000","last_unstale":"2024-09-05T07:50:06.464155+0000","last_undegraded":"2024-09-05T07:50:06.464155+0000","last_fullsized":"2024-09-05T07:50:06.464155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:20:47.539927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'15","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.465388+0000","last_change":"2024-09-05T07:49:12.621601+0000","last_active":"2024-09-05T07:50:06.465388+0000","last_peered":"2024-09-05T07:50:06.465388+0000","last_clean":"2024-09-05T07:50:06.465388+0000","last_became_active":"2024-09-05T07:49:12.621285+0000","last_became_peered":"2024-09-05T07:49:12.621285+0000","last_unstale":"2024-09-05T07:50:06.465388+0000","last_undegraded":"2024-09-05T07:50:06.465388+0000","last_fullsized":"2024-09-05T07:50:06.465388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:54:28.216480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468134+0000","last_change":"2024-09-05T07:49:14.963083+0000","last_active":"2024-09-05T07:50:06.468134+0000","last_peered":"2024-09-05T07:50:06.468134+0000","last_clean":"2024-09-05T07:50:06.468134+0000","last_became_active":"2024-09-05T07:49:14.962763+0000","last_became_peered":"2024-09-05T07:49:14.962763+0000","last_unstale":"2024-09-05T07:50:06.468134+0000","last_undegraded":"2024-09-05T07:50:06.468134+0000","last_fullsized":"2024-09-05T07:50:06.468134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:41.475517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.853262+0000","last_change":"2024-09-05T07:49:12.630250+0000","last_active":"2024-09-05T07:50:06.853262+0000","last_peered":"2024-09-05T07:50:06.853262+0000","last_clean":"2024-09-05T07:50:06.853262+0000","last_became_active":"2024-09-05T07:49:12.629953+0000","last_became_peered":"2024-09-05T07:49:12.629953+0000","last_unstale":"2024-09-05T07:50:06.853262+0000","last_undegraded":"2024-09-05T07:50:06.853262+0000","last_fullsized":"2024-09-05T07:50:06.853262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:30:26.217587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467551+0000","last_change":"2024-09-05T07:49:14.965623+0000","last_active":"2024-09-05T07:50:06.467551+0000","last_peered":"2024-09-05T07:50:06.467551+0000","last_clean":"2024-09-05T07:50:06.467551+0000","last_became_active":"2024-09-05T07:49:14.964544+0000","last_became_peered":"2024-09-05T07:49:14.964544+0000","last_unstale":"2024-09-05T07:50:06.467551+0000","last_undegraded":"2024-09-05T07:50:06.467551+0000","last_fullsized":"2024-09-05T07:50:06.467551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:03:51.723187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464559+0000","last_change":"2024-09-05T07:49:12.922943+0000","last_active":"2024-09-05T07:50:06.464559+0000","last_peered":"2024-09-05T07:50:06.464559+0000","last_clean":"2024-09-05T07:50:06.464559+0000","last_became_active":"2024-09-05T07:49:12.922553+0000","last_became_peered":"2024-09-05T07:49:12.922553+0000","last_unstale":"2024-09-05T07:50:06.464559+0000","last_undegraded":"2024-09-05T07:50:06.464559+0000","last_fullsized":"2024-09-05T07:50:06.464559+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:08:39.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.463917+0000","last_change":"2024-09-05T07:49:14.950904+0000","last_active":"2024-09-05T07:50:06.463917+0000","last_peered":"2024-09-05T07:50:06.463917+0000","last_clean":"2024-09-05T07:50:06.463917+0000","last_became_active":"2024-09-05T07:49:14.950553+0000","last_became_peered":"2024-09-05T07:49:14.950553+0000","last_unstale":"2024-09-05T07:50:06.463917+0000","last_undegraded":"2024-09-05T07:50:06.463917+0000","last_fullsized":"2024-09-05T07:50:06.463917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:31:35.255414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468028+0000","last_change":"2024-09-05T07:49:12.617926+0000","last_active":"2024-09-05T07:50:06.468028+0000","last_peered":"2024-09-05T07:50:06.468028+0000","last_clean":"2024-09-05T07:50:06.468028+0000","last_became_active":"2024-09-05T07:49:12.617168+0000","last_became_peered":"2024-09-05T07:49:12.617168+0000","last_unstale":"2024-09-05T07:50:06.468028+0000","last_undegraded":"2024-09-05T07:50:06.468028+0000","last_fullsized":"2024-09-05T07:50:06.468028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:32:24.934339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464170+0000","last_change":"2024-09-05T07:49:14.951658+0000","last_active":"2024-09-05T07:50:06.464170+0000","last_peered":"2024-09-05T07:50:06.464170+0000","last_clean":"2024-09-05T07:50:06.464170+0000","last_became_active":"2024-09-05T07:49:14.951328+0000","last_became_peered":"2024-09-05T07:49:14.951328+0000","last_unstale":"2024-09-05T07:50:06.464170+0000","last_undegraded":"2024-09-05T07:50:06.464170+0000","last_fullsized":"2024-09-05T07:50:06.464170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:30:06.429805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.860873+0000","last_change":"2024-09-05T07:50:06.860347+0000","last_active":"2024-09-05T07:50:06.860873+0000","last_peered":"2024-09-05T07:50:06.860873+0000","last_clean":"2024-09-05T07:50:06.860873+0000","last_became_active":"2024-09-05T07:50:06.853682+0000","last_became_peered":"2024-09-05T07:50:06.853682+0000","last_unstale":"2024-09-05T07:50:06.860873+0000","last_undegraded":"2024-09-05T07:50:06.860873+0000","last_fullsized":"2024-09-05T07:50:06.860873+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:50:29.761324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,4],"acting":[11,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468391+0000","last_change":"2024-09-05T07:49:14.963017+0000","last_active":"2024-09-05T07:50:06.468391+0000","last_peered":"2024-09-05T07:50:06.468391+0000","last_clean":"2024-09-05T07:50:06.468391+0000","last_became_active":"2024-09-05T07:49:14.962655+0000","last_became_peered":"2024-09-05T07:49:14.962655+0000","last_unstale":"2024-09-05T07:50:06.468391+0000","last_undegraded":"2024-09-05T07:50:06.468391+0000","last_fullsized":"2024-09-05T07:50:06.468391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:59.068930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.863532+0000","last_change":"2024-09-05T07:50:06.863532+0000","last_active":"2024-09-05T07:50:06.863532+0000","last_peered":"2024-09-05T07:50:06.863532+0000","last_clean":"2024-09-05T07:50:06.863532+0000","last_became_active":"2024-09-05T07:50:06.854452+0000","last_became_peered":"2024-09-05T07:50:06.854452+0000","last_unstale":"2024-09-05T07:50:06.863532+0000","last_undegraded":"2024-09-05T07:50:06.863532+0000","last_fullsized":"2024-09-05T07:50:06.863532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:21.076553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467234+0000","last_change":"2024-09-05T07:49:14.953562+0000","last_active":"2024-09-05T07:50:06.467234+0000","last_peered":"2024-09-05T07:50:06.467234+0000","last_clean":"2024-09-05T07:50:06.467234+0000","last_became_active":"2024-09-05T07:49:14.953242+0000","last_became_peered":"2024-09-05T07:49:14.953242+0000","last_unstale":"2024-09-05T07:50:06.467234+0000","last_undegraded":"2024-09-05T07:50:06.467234+0000","last_fullsized":"2024-09-05T07:50:06.467234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:02.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.470164+0000","last_change":"2024-09-05T07:50:06.470164+0000","last_active":"2024-09-05T07:50:06.470164+0000","last_peered":"2024-09-05T07:50:06.470164+0000","last_clean":"2024-09-05T07:50:06.470164+0000","last_became_active":"2024-09-05T07:50:06.469748+0000","last_became_peered":"2024-09-05T07:50:06.469748+0000","last_unstale":"2024-09-05T07:50:06.470164+0000","last_undegraded":"2024-09-05T07:50:06.470164+0000","last_fullsized":"2024-09-05T07:50:06.470164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:52.591811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464785+0000","last_change":"2024-09-05T07:49:12.624583+0000","last_active":"2024-09-05T07:50:06.464785+0000","last_peered":"2024-09-05T07:50:06.464785+0000","last_clean":"2024-09-05T07:50:06.464785+0000","last_became_active":"2024-09-05T07:49:12.624184+0000","last_became_peered":"2024-09-05T07:49:12.624184+0000","last_unstale":"2024-09-05T07:50:06.464785+0000","last_undegraded":"2024-09-05T07:50:06.464785+0000","last_fullsized":"2024-09-05T07:50:06.464785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:46:33.137089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.464561+0000","last_change":"2024-09-05T07:49:14.955735+0000","last_active":"2024-09-05T07:50:06.464561+0000","last_peered":"2024-09-05T07:50:06.464561+0000","last_clean":"2024-09-05T07:50:06.464561+0000","last_became_active":"2024-09-05T07:49:14.955388+0000","last_became_peered":"2024-09-05T07:49:14.955388+0000","last_unstale":"2024-09-05T07:50:06.464561+0000","last_undegraded":"2024-09-05T07:50:06.464561+0000","last_fullsized":"2024-09-05T07:50:06.464561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:07:15.436676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.479510+0000","last_change":"2024-09-05T07:50:06.479120+0000","last_active":"2024-09-05T07:50:06.479510+0000","last_peered":"2024-09-05T07:50:06.479510+0000","last_clean":"2024-09-05T07:50:06.479510+0000","last_became_active":"2024-09-05T07:50:06.468059+0000","last_became_peered":"2024-09-05T07:50:06.468059+0000","last_unstale":"2024-09-05T07:50:06.479510+0000","last_undegraded":"2024-09-05T07:50:06.479510+0000","last_fullsized":"2024-09-05T07:50:06.479510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:05:55.676017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467257+0000","last_change":"2024-09-05T07:49:14.952234+0000","last_active":"2024-09-05T07:50:06.467257+0000","last_peered":"2024-09-05T07:50:06.467257+0000","last_clean":"2024-09-05T07:50:06.467257+0000","last_became_active":"2024-09-05T07:49:14.948805+0000","last_became_peered":"2024-09-05T07:49:14.948805+0000","last_unstale":"2024-09-05T07:50:06.467257+0000","last_undegraded":"2024-09-05T07:50:06.467257+0000","last_fullsized":"2024-09-05T07:50:06.467257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:49.101303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.468197+0000","last_change":"2024-09-05T07:49:12.922749+0000","last_active":"2024-09-05T07:50:06.468197+0000","last_peered":"2024-09-05T07:50:06.468197+0000","last_clean":"2024-09-05T07:50:06.468197+0000","last_became_active":"2024-09-05T07:49:12.922415+0000","last_became_peered":"2024-09-05T07:49:12.922415+0000","last_unstale":"2024-09-05T07:50:06.468197+0000","last_undegraded":"2024-09-05T07:50:06.468197+0000","last_fullsized":"2024-09-05T07:50:06.468197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:19:58.163647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:06.467972+0000","last_change":"2024-09-05T07:49:14.957792+0000","last_active":"2024-09-05T07:50:06.467972+0000","last_peered":"2024-09-05T07:50:06.467972+0000","last_clean":"2024-09-05T07:50:06.467972+0000","last_became_active":"2024-09-05T07:49:14.957312+0000","last_became_peered":"2024-09-05T07:49:14.957312+0000","last_unstale":"2024-09-05T07:50:06.467972+0000","last_undegraded":"2024-09-05T07:50:06.467972+0000","last_fullsized":"2024-09-05T07:50:06.467972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:13.921474+0000","last_clean_scrub_stamp":"2024-09-05T07:49:13.921474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:55:17.422990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":95,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-05T07:50:25.443937+0000","last_change":"2024-09-05T07:49:12.621834+0000","last_active":"2024-09-05T07:50:25.443937+0000","last_peered":"2024-09-05T07:50:25.443937+0000","last_clean":"2024-09-05T07:50:25.443937+0000","last_became_active":"2024-09-05T07:49:12.621446+0000","last_became_peered":"2024-09-05T07:49:12.621446+0000","last_unstale":"2024-09-05T07:50:25.443937+0000","last_undegraded":"2024-09-05T07:50:25.443937+0000","last_fullsized":"2024-09-05T07:50:25.443937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:49:11.600721+0000","last_clean_scrub_stamp":"2024-09-05T07:49:11.600721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:32.790982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68291,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":632,"num_read_kb":392,"num_write":244,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282052,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481821,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":447844,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710754,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1085440,"data_stored":1099956,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874278,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":447774,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":448152,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364850,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":1041458,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528376,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":447884,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1040350,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":447745,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":447316,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1019904,"data_stored":509707,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":509487,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":958464,"data_stored":448830,"data_compressed":5774,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35873,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:50:31.580 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T07:50:31.580 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T07:50:31.581 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-05T07:50:31.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph health --format=json 2024-09-05T07:50:31.949 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:32.418 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:32 smithi144 ceph-mon[29535]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:32.418 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:32 smithi144 ceph-mon[29535]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:32.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 -- 172.21.15.144:0/3328615707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 msgr2=0x7f4858110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:32.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 --2- 172.21.15.144:0/3328615707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f4858110ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4850009ca0 tx=0x7f485002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 -- 172.21.15.144:0/3328615707 shutdown_connections 2024-09-05T07:50:32.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 --2- 172.21.15.144:0/3328615707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f4858110ae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 --2- 172.21.15.144:0/3328615707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48581047e0 0x7f4858108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 --2- 172.21.15.144:0/3328615707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4858103e30 0x7f4858104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 -- 172.21.15.144:0/3328615707 >> 172.21.15.144:0/3328615707 conn(0x7f48580ff8d0 msgr2=0x7f4858101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 -- 172.21.15.144:0/3328615707 shutdown_connections 2024-09-05T07:50:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.631+0000 7f485d200640 1 -- 172.21.15.144:0/3328615707 wait complete. 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.632+0000 7f485d200640 1 Processor -- start 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 -- start start 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858103e30 0x7f485819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f485819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113fc0 con 0x7f4858108f60 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113e40 con 0x7f48581047e0 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f485d200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4858114140 con 0x7f4858103e30 2024-09-05T07:50:32.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f484fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:32.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f484fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35790/0 (socket says 172.21.15.144:35790) 2024-09-05T07:50:32.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f4857e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f485819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:32.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f484fe00640 1 -- 172.21.15.144:0/467188053 learned_addr learned my addr 172.21.15.144:0/467188053 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:32.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.633+0000 7f4857400640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858103e30 0x7f485819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 -- 172.21.15.144:0/467188053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858103e30 msgr2=0x7f485819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858103e30 0x7f485819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 -- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 msgr2=0x7f485819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f485819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 -- 172.21.15.144:0/467188053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485819f3b0 con 0x7f48581047e0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f484fe00640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f484000d950 tx=0x7f484000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840017070 con 0x7f48581047e0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485819f6a0 con 0x7f48581047e0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4840009c30 con 0x7f48581047e0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.634+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484000f6b0 con 0x7f48581047e0 2024-09-05T07:50:32.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.635+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581a6f80 con 0x7f48581047e0 2024-09-05T07:50:32.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.635+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4858104210 con 0x7f48581047e0 2024-09-05T07:50:32.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.638+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f48400109d0 con 0x7f48581047e0 2024-09-05T07:50:32.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.639+0000 7f4854c00640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 0x7f483c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:32.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.639+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f48400ced50 con 0x7f48581047e0 2024-09-05T07:50:32.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.639+0000 7f4857400640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 0x7f483c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:32.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.640+0000 7f4857400640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 0x7f483c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4848009bd0 tx=0x7f4848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:32.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.641+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4840009de0 con 0x7f48581047e0 2024-09-05T07:50:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:32 smithi154 ceph-mon[34710]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:32 smithi154 ceph-mon[34710]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:32 smithi175 ceph-mon[34585]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T07:50:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:32 smithi175 ceph-mon[34585]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:32.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.854+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f485810c200 con 0x7f48581047e0 2024-09-05T07:50:32.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.855+0000 7f4854c00640 1 -- 172.21.15.144:0/467188053 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f484009b490 con 0x7f48581047e0 2024-09-05T07:50:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:32.856 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T07:50:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.857+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 msgr2=0x7f483c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.857+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 0x7f483c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4848009bd0 tx=0x7f4848005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.857+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 msgr2=0x7f485819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.857+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f484000d950 tx=0x7f484000de10 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 shutdown_connections 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f483c0a2c10 0x7f483c0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48581047e0 0x7f485819a940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4858108f60 0x7f485819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 --2- 172.21.15.144:0/467188053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858103e30 0x7f485819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 >> 172.21.15.144:0/467188053 conn(0x7f48580ff8d0 msgr2=0x7f4858100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 shutdown_connections 2024-09-05T07:50:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:32.858+0000 7f485d200640 1 -- 172.21.15.144:0/467188053 wait complete. 2024-09-05T07:50:33.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:33 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/467188053' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T07:50:33.624 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-05T07:50:33.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:50:33.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:33 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/467188053' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T07:50:33.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:33 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/467188053' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T07:50:33.992 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:34.463 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:34 smithi144 ceph-mon[29535]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 -- 172.21.15.144:0/2476664575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 msgr2=0x7fad7c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 --2- 172.21.15.144:0/2476664575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c10de80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad68009900 tx=0x7fad6802a480 comp rx=0 tx=0).stop 2024-09-05T07:50:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 -- 172.21.15.144:0/2476664575 shutdown_connections 2024-09-05T07:50:34.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 --2- 172.21.15.144:0/2476664575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c10e3c0 0x7fad7c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 --2- 172.21.15.144:0/2476664575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c10de80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 --2- 172.21.15.144:0/2476664575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c074620 0x7fad7c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.572+0000 7fad83e00640 1 -- 172.21.15.144:0/2476664575 >> 172.21.15.144:0/2476664575 conn(0x7fad7c0fd8c0 msgr2=0x7fad7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:34.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.573+0000 7fad83e00640 1 -- 172.21.15.144:0/2476664575 shutdown_connections 2024-09-05T07:50:34.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.573+0000 7fad83e00640 1 -- 172.21.15.144:0/2476664575 wait complete. 2024-09-05T07:50:34.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.573+0000 7fad83e00640 1 Processor -- start 2024-09-05T07:50:34.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 -- start start 2024-09-05T07:50:34.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 0x7fad7c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:34.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:34.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c10e3c0 0x7fad7c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:34.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c1141b0 con 0x7fad7c074f40 2024-09-05T07:50:34.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c114030 con 0x7fad7c074620 2024-09-05T07:50:34.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad83e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c114330 con 0x7fad7c10e3c0 2024-09-05T07:50:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad80a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad80a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59492/0 (socket says 172.21.15.144:59492) 2024-09-05T07:50:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad80a00640 1 -- 172.21.15.144:0/3055291040 learned_addr learned my addr 172.21.15.144:0/3055291040 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad81400640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 0x7fad7c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.574+0000 7fad81e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c10e3c0 0x7fad7c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 -- 172.21.15.144:0/3055291040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c10e3c0 msgr2=0x7fad7c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c10e3c0 0x7fad7c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 -- 172.21.15.144:0/3055291040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 msgr2=0x7fad7c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 0x7fad7c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 -- 172.21.15.144:0/3055291040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c19f660 con 0x7fad7c074f40 2024-09-05T07:50:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad81400640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 0x7fad7c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad80a00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad68004770 tx=0x7fad68003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6803f070 con 0x7fad7c074f40 2024-09-05T07:50:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad68031ca0 con 0x7fad7c074f40 2024-09-05T07:50:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68035030 con 0x7fad7c074f40 2024-09-05T07:50:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c19f8f0 con 0x7fad7c074f40 2024-09-05T07:50:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.575+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c19fd80 con 0x7fad7c074f40 2024-09-05T07:50:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.577+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c074a00 con 0x7fad7c074f40 2024-09-05T07:50:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.578+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fad68042070 con 0x7fad7c074f40 2024-09-05T07:50:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.580+0000 7fad7a000640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 0x7fad640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.580+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fad680ef840 con 0x7fad7c074f40 2024-09-05T07:50:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.580+0000 7fad81400640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 0x7fad640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.580+0000 7fad81400640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 0x7fad640a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fad70009fc0 tx=0x7fad70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.584+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad680bbf80 con 0x7fad7c074f40 2024-09-05T07:50:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:34 smithi154 ceph-mon[34710]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:34.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.796+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad7c108fb0 con 0x7fad7c074f40 2024-09-05T07:50:34.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.797+0000 7fad7a000640 1 -- 172.21.15.144:0/3055291040 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7fad680c0280 con 0x7fad7c074f40 2024-09-05T07:50:34.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:34.799 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:50:34.800 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:50:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 msgr2=0x7fad640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 0x7fad640a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fad70009fc0 tx=0x7fad70005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 msgr2=0x7fad7c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad68004770 tx=0x7fad68003c10 comp rx=0 tx=0).stop 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 shutdown_connections 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fad640a2c90 0x7fad640a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad7c10e3c0 0x7fad7c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad7c074f40 0x7fad7c19abf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 --2- 172.21.15.144:0/3055291040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c074620 0x7fad7c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 >> 172.21.15.144:0/3055291040 conn(0x7fad7c0fd8c0 msgr2=0x7fad7c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.801+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 shutdown_connections 2024-09-05T07:50:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:34.802+0000 7fad83e00640 1 -- 172.21.15.144:0/3055291040 wait complete. 2024-09-05T07:50:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:34 smithi175 ceph-mon[34585]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:35.537 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:35 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3055291040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:35.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:50:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:35 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3055291040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:35.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:35 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3055291040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 -- 172.21.15.144:0/3398396282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f01047e0 msgr2=0x7f34f0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 --2- 172.21.15.144:0/3398396282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f01047e0 0x7f34f0108830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009900 tx=0x7f34e002a410 comp rx=0 tx=0).stop 2024-09-05T07:50:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 -- 172.21.15.144:0/3398396282 shutdown_connections 2024-09-05T07:50:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 --2- 172.21.15.144:0/3398396282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f0108f60 0x7f34f0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 --2- 172.21.15.144:0/3398396282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f01047e0 0x7f34f0108830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 --2- 172.21.15.144:0/3398396282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 -- 172.21.15.144:0/3398396282 >> 172.21.15.144:0/3398396282 conn(0x7f34f00ff910 msgr2=0x7f34f0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 -- 172.21.15.144:0/3398396282 shutdown_connections 2024-09-05T07:50:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.506+0000 7f34f7200640 1 -- 172.21.15.144:0/3398396282 wait complete. 2024-09-05T07:50:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 Processor -- start 2024-09-05T07:50:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 -- start start 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 0x7f34f019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 0x7f34f019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0114010 con 0x7f34f0108f60 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0113e90 con 0x7f34f01047e0 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.507+0000 7f34f7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0114190 con 0x7f34f0103e30 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 0x7f34f019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 0x7f34f019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 0x7f34f019edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59504/0 (socket says 172.21.15.144:59504) 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f6800640 1 -- 172.21.15.144:0/576924456 learned_addr learned my addr 172.21.15.144:0/576924456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 -- 172.21.15.144:0/576924456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 msgr2=0x7f34f019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 -- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 msgr2=0x7f34f019edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 0x7f34f019edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5400640 1 -- 172.21.15.144:0/576924456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f019f4a0 con 0x7f34f01047e0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.508+0000 7f34f5e00640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34f5400640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 0x7f34f019aa30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f34e002a930 tx=0x7f34e0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e003f070 con 0x7f34f01047e0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34e0031c90 con 0x7f34f01047e0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f019f730 con 0x7f34f01047e0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0035030 con 0x7f34f01047e0 2024-09-05T07:50:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.509+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f01a7070 con 0x7f34f01047e0 2024-09-05T07:50:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.510+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f0105310 con 0x7f34f01047e0 2024-09-05T07:50:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.512+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f34e0042070 con 0x7f34f01047e0 2024-09-05T07:50:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.513+0000 7f34eaa00640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 0x7f34d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.514+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f34e00efe10 con 0x7f34f01047e0 2024-09-05T07:50:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.514+0000 7f34f5e00640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 0x7f34d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.514+0000 7f34f5e00640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 0x7f34d80a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009fc0 tx=0x7f34e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.515+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34e00bc5b0 con 0x7f34f01047e0 2024-09-05T07:50:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:36 smithi154 ceph-mon[34710]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:36.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.727+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34f0104210 con 0x7f34f01047e0 2024-09-05T07:50:36.727 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:36 smithi144 ceph-mon[29535]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:36.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.729+0000 7f34eaa00640 1 -- 172.21.15.144:0/576924456 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7f34f0104210 con 0x7f34f01047e0 2024-09-05T07:50:36.729 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:36.729 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:50:36.729 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:50:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 msgr2=0x7f34d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 0x7f34d80a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009fc0 tx=0x7f34e4005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 msgr2=0x7f34f019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 0x7f34f019aa30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f34e002a930 tx=0x7f34e0003b90 comp rx=0 tx=0).stop 2024-09-05T07:50:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 shutdown_connections 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34d80a2c10 0x7f34d80a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f01047e0 0x7f34f019aa30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f0108f60 0x7f34f019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 --2- 172.21.15.144:0/576924456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f0103e30 0x7f34f019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 >> 172.21.15.144:0/576924456 conn(0x7f34f00ff910 msgr2=0x7f34f0100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.731+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 shutdown_connections 2024-09-05T07:50:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:36.732+0000 7f34f7200640 1 -- 172.21.15.144:0/576924456 wait complete. 2024-09-05T07:50:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:36 smithi175 ceph-mon[34585]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:37.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:50:37.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:37 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/576924456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:37.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:37 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/576924456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:37.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:37 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/576924456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:37.881 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:38.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 -- 172.21.15.144:0/4140705615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea810e450 msgr2=0x7f5ea8110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:38.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 --2- 172.21.15.144:0/4140705615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea810e450 0x7f5ea8110840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009ca0 tx=0x7f5ea002a940 comp rx=0 tx=0).stop 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 -- 172.21.15.144:0/4140705615 shutdown_connections 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 --2- 172.21.15.144:0/4140705615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea810e450 0x7f5ea8110840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 --2- 172.21.15.144:0/4140705615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074e30 0x7f5ea810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 --2- 172.21.15.144:0/4140705615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea8074510 0x7f5ea80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 -- 172.21.15.144:0/4140705615 >> 172.21.15.144:0/4140705615 conn(0x7f5ea80fd8b0 msgr2=0x7f5ea80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 -- 172.21.15.144:0/4140705615 shutdown_connections 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.466+0000 7f5ead400640 1 -- 172.21.15.144:0/4140705615 wait complete. 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.467+0000 7f5ead400640 1 Processor -- start 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 -- start start 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:38.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8074e30 0x7f5ea819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea810e450 0x7f5ea819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8114160 con 0x7f5ea8074510 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8113fe0 con 0x7f5ea810e450 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ead400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81142e0 con 0x7f5ea8074e30 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59510/0 (socket says 172.21.15.144:59510) 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea6800640 1 -- 172.21.15.144:0/2201599530 learned_addr learned my addr 172.21.15.144:0/2201599530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea5e00640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8074e30 0x7f5ea819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea7200640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea810e450 0x7f5ea819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.468+0000 7f5ea6800640 1 -- 172.21.15.144:0/2201599530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8074e30 msgr2=0x7f5ea819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:38.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ea6800640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8074e30 0x7f5ea819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ea6800640 1 -- 172.21.15.144:0/2201599530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea810e450 msgr2=0x7f5ea819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ea6800640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea810e450 0x7f5ea819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ea6800640 1 -- 172.21.15.144:0/2201599530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea819f5b0 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ea6800640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800e9f0 tx=0x7f5e9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800cd80 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea819f8a0 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e98010910 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e980188f0 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.469+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81a7180 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.470+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea80748f0 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.473+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5e98010ac0 con 0x7f5ea8074510 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.474+0000 7f5e9f400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 0x7f5e8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:38.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.474+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f5e980cf9d0 con 0x7f5ea8074510 2024-09-05T07:50:38.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.474+0000 7f5ea5e00640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 0x7f5e8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:38.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.475+0000 7f5ea5e00640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 0x7f5e8c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5e940095f0 tx=0x7f5e94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:38.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.476+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e9809c110 con 0x7f5ea8074510 2024-09-05T07:50:38.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.654+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ea81a7420 con 0x7f5ea8074510 2024-09-05T07:50:38.654 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:38 smithi144 ceph-mon[29535]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:38.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.655+0000 7f5e9f400640 1 -- 172.21.15.144:0/2201599530 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22868 (secure 0 0 0) 0x7f5e980a0410 con 0x7f5ea8074510 2024-09-05T07:50:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:38.656 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":85,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:50:06.457858+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:50:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 msgr2=0x7f5e8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 0x7f5e8c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5e940095f0 tx=0x7f5e94005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 msgr2=0x7f5ea819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800e9f0 tx=0x7f5e9800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 shutdown_connections 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e8c0a2c10 0x7f5e8c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea810e450 0x7f5ea819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8074e30 0x7f5ea819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 --2- 172.21.15.144:0/2201599530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea8074510 0x7f5ea819a600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.658+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 >> 172.21.15.144:0/2201599530 conn(0x7f5ea80fd8b0 msgr2=0x7f5ea80fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.659+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 shutdown_connections 2024-09-05T07:50:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:38.659+0000 7f5ead400640 1 -- 172.21.15.144:0/2201599530 wait complete. 2024-09-05T07:50:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:38 smithi154 ceph-mon[34710]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:38 smithi175 ceph-mon[34585]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:39.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:50:39.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:39 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2201599530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:50:39.757 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:39.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:39 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2201599530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:50:39.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:39 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2201599530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 -- 172.21.15.144:0/1488454449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c101de0 msgr2=0x7f508c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 --2- 172.21.15.144:0/1488454449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c101de0 0x7f508c1021c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f507c009900 tx=0x7f507c02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 -- 172.21.15.144:0/1488454449 shutdown_connections 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 --2- 172.21.15.144:0/1488454449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c102790 0x7f508c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 --2- 172.21.15.144:0/1488454449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c106f10 0x7f508c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 --2- 172.21.15.144:0/1488454449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c101de0 0x7f508c1021c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 -- 172.21.15.144:0/1488454449 >> 172.21.15.144:0/1488454449 conn(0x7f508c0fd8c0 msgr2=0x7f508c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 -- 172.21.15.144:0/1488454449 shutdown_connections 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.329+0000 7f5091200640 1 -- 172.21.15.144:0/1488454449 wait complete. 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.330+0000 7f5091200640 1 Processor -- start 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.330+0000 7f5091200640 1 -- start start 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c101de0 0x7f508c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 0x7f508c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f508c111f70 con 0x7f508c106f10 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f508c111df0 con 0x7f508c101de0 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5091200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1120f0 con 0x7f508c102790 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f508a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f508a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59530/0 (socket says 172.21.15.144:59530) 2024-09-05T07:50:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f508a800640 1 -- 172.21.15.144:0/2095178935 learned_addr learned my addr 172.21.15.144:0/2095178935 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5089e00640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c101de0 0x7f508c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f5089400640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 0x7f508c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f508a800640 1 -- 172.21.15.144:0/2095178935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 msgr2=0x7f508c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.331+0000 7f508a800640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 0x7f508c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f508a800640 1 -- 172.21.15.144:0/2095178935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c101de0 msgr2=0x7f508c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f508a800640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c101de0 0x7f508c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f508a800640 1 -- 172.21.15.144:0/2095178935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c19f5f0 con 0x7f508c106f10 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5089400640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 0x7f508c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f508a800640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f508400eb10 tx=0x7f508400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084004b20 con 0x7f508c106f10 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c19f8e0 con 0x7f508c106f10 2024-09-05T07:50:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084004cc0 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084010760 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.332+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1a71c0 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.334+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c1021c0 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.335+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5084005020 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.336+0000 7f5082a00640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 0x7f50700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.337+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f50840cf7f0 con 0x7f508c106f10 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.337+0000 7f5089e00640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 0x7f50700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.337+0000 7f5089e00640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 0x7f50700a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f507c009230 tx=0x7f507c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.341+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f508409c580 con 0x7f508c106f10 2024-09-05T07:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.553+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f508c1a7500 con 0x7f508c106f10 2024-09-05T07:50:40.553 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:40 smithi144 ceph-mon[29535]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.554+0000 7f5082a00640 1 -- 172.21.15.144:0/2095178935 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7f508409be80 con 0x7f508c106f10 2024-09-05T07:50:40.554 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:50:40.554 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 msgr2=0x7f50700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 0x7f50700a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f507c009230 tx=0x7f507c0058d0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 msgr2=0x7f508c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f508400eb10 tx=0x7f508400c2d0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 shutdown_connections 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f50700a2c90 0x7f50700a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508c106f10 0x7f508c19ef10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508c102790 0x7f508c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 --2- 172.21.15.144:0/2095178935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f508c101de0 0x7f508c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 >> 172.21.15.144:0/2095178935 conn(0x7f508c0fd8c0 msgr2=0x7f508c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 shutdown_connections 2024-09-05T07:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:40.557+0000 7f5091200640 1 -- 172.21.15.144:0/2095178935 wait complete. 2024-09-05T07:50:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:40 smithi154 ceph-mon[34710]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:40 smithi175 ceph-mon[34585]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:41.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T07:49:15.848520+0000', 'modified': '2024-09-05T07:49:29.252641+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24523, 'mds_2': 24521, 'mds_3': 24508, 'mds_4': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/292119763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 292119763}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 292119763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3404092101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3404092101}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3404092101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'd', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/2196844760', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 2196844760}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2196844760}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/2155086348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2155086348}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2155086348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/4186875626', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 4186875626}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 4186875626}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.175:6835/1249902842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1249902842}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1249902842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.175:6837/470737720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 470737720}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 470737720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'a', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6841/1329376648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6840', 'nonce': 1329376648}, {'type': 'v1', 'addr': '172.21.15.144:6841', 'nonce': 1329376648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.175:6839/571012615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 571012615}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 571012615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/3557171279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3557171279}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3557171279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24533, 'qdb_cluster': [24502, 24508, 24521, 24523, 24533]} 2024-09-05T07:50:41.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-05T07:50:41.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.f status 2024-09-05T07:50:41.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:41 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2095178935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:41.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2095178935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:41.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:41 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2095178935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:50:42.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.323+0000 7f0d9d600640 1 -- 172.21.15.144:0/63806847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98077040 msgr2=0x7f0d98112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.323+0000 7f0d9d600640 1 --2- 172.21.15.144:0/63806847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98077040 0x7f0d98112510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009900 tx=0x7f0d8402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 -- 172.21.15.144:0/63806847 shutdown_connections 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 --2- 172.21.15.144:0/63806847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98112a50 0x7f0d98114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 --2- 172.21.15.144:0/63806847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98077040 0x7f0d98112510 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 --2- 172.21.15.144:0/63806847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98076720 0x7f0d98076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 -- 172.21.15.144:0/63806847 >> 172.21.15.144:0/63806847 conn(0x7f0d980ffa50 msgr2=0x7f0d98101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 -- 172.21.15.144:0/63806847 shutdown_connections 2024-09-05T07:50:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.324+0000 7f0d9d600640 1 -- 172.21.15.144:0/63806847 wait complete. 2024-09-05T07:50:42.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 Processor -- start 2024-09-05T07:50:42.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 -- start start 2024-09-05T07:50:42.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 0x7f0d981a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 0x7f0d9819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981185e0 con 0x7f0d98076720 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98118460 con 0x7f0d98077040 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d9d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98118760 con 0x7f0d98112a50 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d96a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d96a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59548/0 (socket says 172.21.15.144:59548) 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d96a00640 1 -- 172.21.15.144:0/3022921637 learned_addr learned my addr 172.21.15.144:0/3022921637 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d97400640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 0x7f0d9819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.325+0000 7f0d96000640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 0x7f0d981a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 -- 172.21.15.144:0/3022921637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 msgr2=0x7f0d9819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 0x7f0d9819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 -- 172.21.15.144:0/3022921637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 msgr2=0x7f0d981a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 0x7f0d981a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 -- 172.21.15.144:0/3022921637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9819f040 con 0x7f0d98076720 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d97400640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 0x7f0d9819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96000640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 0x7f0d981a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d96a00640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e9f0 tx=0x7f0d8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.326+0000 7f0d8f400640 1 -- 172.21.15.144:0/3022921637 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800cd80 con 0x7f0d98076720 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.327+0000 7f0d8f400640 1 -- 172.21.15.144:0/3022921637 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d88005500 con 0x7f0d98076720 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.327+0000 7f0d8f400640 1 -- 172.21.15.144:0/3022921637 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88010690 con 0x7f0d98076720 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.327+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9819f330 con 0x7f0d98076720 2024-09-05T07:50:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.327+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d981ab620 con 0x7f0d98076720 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0d8f400640 1 -- 172.21.15.144:0/3022921637 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0d880046c0 con 0x7f0d98076720 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 Processor -- start 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 -- start start 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe69fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe6c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582bfdc50b0 con 0x5582bfe6a510 2024-09-05T07:50:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582bfd6cab0 con 0x5582bfe5fc50 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.330+0000 7f0da01e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582bfdc1070 con 0x5582bfe5f330 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d96a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe69fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d96000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe6c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:42324/0 (socket says 172.21.15.144:42324) 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 -- 172.21.15.144:0/840575337 learned_addr learned my addr 172.21.15.144:0/840575337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 -- 172.21.15.144:0/840575337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 msgr2=0x5582bfe69fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe69fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 -- 172.21.15.144:0/840575337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 msgr2=0x5582bfe6c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe6c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 -- 172.21.15.144:0/840575337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bfd794a0 con 0x5582bfe5f330 2024-09-05T07:50:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d97400640 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d90011790 tx=0x7f0d90011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d459201a7d344177 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d83400640 1 -- 172.21.15.144:0/840575337 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003c30 con 0x5582bfe5f330 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.331+0000 7f0d8f400640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 0x7f0d7c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0d83400640 1 -- 172.21.15.144:0/840575337 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d90003dd0 con 0x5582bfe5f330 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0d83400640 1 -- 172.21.15.144:0/840575337 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d900193e0 con 0x5582bfe5f330 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0d8f400640 1 -- 172.21.15.144:0/3022921637 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f0d880cf5c0 con 0x7f0d98076720 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0d96a00640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 0x7f0d7c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0da01e8740 1 -- 172.21.15.144:0/840575337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 msgr2=0x5582bfe5f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0d96a00640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 0x7f0d7c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d880980b0 tx=0x7f0d880d50e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.332+0000 7f0da01e8740 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d90011790 tx=0x7f0d90011b90 comp rx=0 tx=0).stop 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 -- 172.21.15.144:0/840575337 shutdown_connections 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe69fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 --2- 172.21.15.144:0/840575337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe5f710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 -- 172.21.15.144:0/840575337 >> 172.21.15.144:0/840575337 conn(0x5582bfe5b8c0 msgr2=0x5582bfe5bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 -- 172.21.15.144:0/840575337 shutdown_connections 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 -- 172.21.15.144:0/840575337 wait complete. 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 -- start start 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.333+0000 7f0da01e8740 1 Processor -- start 2024-09-05T07:50:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe67b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe6a510 0x5582bfe68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe6d060 con 0x5582bfe5f330 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582bfd4d920 con 0x5582bfe5fc50 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe6d1e0 con 0x5582bfe6a510 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0da01e8740 10 client.0 _ll_register_callbacks cb 0x5582bfd718a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59576/0 (socket says 172.21.15.144:59576) 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0d97400640 1 -- 172.21.15.144:0/19335519 learned_addr learned my addr 172.21.15.144:0/19335519 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0d96000640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe67b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.334+0000 7f0d97400640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe6a510 0x5582bfe68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 -- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe6a510 msgr2=0x5582bfe68080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe6a510 0x5582bfe68080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 -- 172.21.15.144:0/19335519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 msgr2=0x5582bfe67600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 -- 172.21.15.144:0/19335519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bfb362b0 con 0x5582bfe5fc50 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d97400640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d96000640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe67b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005940 tx=0x7f0d840317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d609dd76eb553c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d77e00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84035040 con 0x5582bfe5fc50 2024-09-05T07:50:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d90003dd0 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.335+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f0d84004450 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d84005020 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 10 client.24878 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582bfe78e60 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d90003dd0 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d840035f0 con 0x5582bfe5fc50 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 10 client.24878 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 10 client.24878 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 20 client.24878 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfe7b400 0x5582bfe7c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 4 client.24878 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.336+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 --> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582bfdd2620 con 0x5582bfe7b400 2024-09-05T07:50:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.337+0000 7f0d97400640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfe7b400 0x5582bfe7c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.337+0000 7f0d97400640 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfe7b400 0x5582bfe7c870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1ba2617714d0b10b server_cookie=3dbf6b464d3ad884 in_seq=0 out_seq=0 2024-09-05T07:50:42.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.337+0000 7f0d77e00640 10 client.24878 ms_handle_connect on v2:172.21.15.175:6834/1249902842 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.338+0000 7f0d77e00640 1 -- 172.21.15.144:0/19335519 <== mds.4 v2:172.21.15.175:6834/1249902842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582bfdd2620 con 0x5582bfe7b400 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.338+0000 7f0d77e00640 10 client.24878 handle_command_reply: tid=0 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 client.24878 shutdown 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 msgr2=0x5582bfe67b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe67b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005940 tx=0x7f0d840317e0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 shutdown_connections 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfe7b400 0x5582bfe7c870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe67b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe6a510 0x5582bfe68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0d77e00640 0 client.24878 ms_handle_reset on v2:172.21.15.175:6834/1249902842 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 --2- 172.21.15.144:0/19335519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe67600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 >> 172.21.15.144:0/19335519 conn(0x5582bfe5b8c0 msgr2=0x5582bfe615a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 shutdown_connections 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 1 -- 172.21.15.144:0/19335519 wait complete. 2024-09-05T07:50:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.339+0000 7f0da01e8740 20 client.24878 trim_cache size 0 max 16384 2024-09-05T07:50:42.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.357+0000 7f0da01e8740 1 Processor -- start 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 -- start start 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7abb0 con 0x5582bfe6a510 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7b280 con 0x5582bfe5fc50 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0da01e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7b950 con 0x5582bfe5f330 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0d97400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0d96000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0d97400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:42352/0 (socket says 172.21.15.144:42352) 2024-09-05T07:50:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.358+0000 7f0d97400640 1 -- 172.21.15.144:0/1186683450 learned_addr learned my addr 172.21.15.144:0/1186683450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 -- 172.21.15.144:0/1186683450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 msgr2=0x5582bfe664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 -- 172.21.15.144:0/1186683450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 msgr2=0x5582bfe648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 -- 172.21.15.144:0/1186683450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bfe5f120 con 0x5582bfe5f330 2024-09-05T07:50:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d96000640 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d97400640 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d900043d0 tx=0x7f0d90004460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f53229630bb16d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d82a00640 1 -- 172.21.15.144:0/1186683450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9001f040 con 0x5582bfe5f330 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d82a00640 1 -- 172.21.15.144:0/1186683450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d9000fd20 con 0x5582bfe5f330 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.359+0000 7f0d82a00640 1 -- 172.21.15.144:0/1186683450 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90010850 con 0x5582bfe5f330 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- 172.21.15.144:0/1186683450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 msgr2=0x5582bfe67ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d900043d0 tx=0x7f0d90004460 comp rx=0 tx=0).stop 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- 172.21.15.144:0/1186683450 shutdown_connections 2024-09-05T07:50:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe5fc50 0x5582bfe664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe6a510 0x5582bfe648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 --2- 172.21.15.144:0/1186683450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5f330 0x5582bfe67ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- 172.21.15.144:0/1186683450 >> 172.21.15.144:0/1186683450 conn(0x5582bfe5b8c0 msgr2=0x5582bfe65de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- 172.21.15.144:0/1186683450 shutdown_connections 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- 172.21.15.144:0/1186683450 wait complete. 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 -- start start 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.360+0000 7f0da01e8740 1 Processor -- start 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5fc50 0x5582bfe64660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe6a510 0x5582bfe64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7c6f0 con 0x5582bfe5f330 2024-09-05T07:50:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7c020 con 0x5582bfe6a510 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582bfe7cdc0 con 0x5582bfe5fc50 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0da01e8740 10 client.0 _ll_register_callbacks cb 0x7f0d84005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59590/0 (socket says 172.21.15.144:59590) 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0d97400640 1 -- 172.21.15.144:0/2296847503 learned_addr learned my addr 172.21.15.144:0/2296847503 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.361+0000 7f0d96000640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5fc50 0x5582bfe64660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe6a510 0x5582bfe64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 -- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5fc50 msgr2=0x5582bfe64660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5fc50 0x5582bfe64660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 -- 172.21.15.144:0/2296847503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe6a510 msgr2=0x5582bfe64df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe6a510 0x5582bfe64df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 -- 172.21.15.144:0/2296847503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bfe82f70 con 0x5582bfe5f330 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d97400640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000f790 tx=0x7f0d90005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ce96af65097f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d77e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000fa40 con 0x5582bfe5f330 2024-09-05T07:50:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f0d90004930 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d9000fd20 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.362+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d90009480 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 10 client.14889 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582bfee5d20 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d9000fd20 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d90041050 con 0x5582bfe5f330 2024-09-05T07:50:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 10 client.14889 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 10 client.14889 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 20 client.14889 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfeea0e0 0x5582bfee8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 4 client.14889 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 --> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] -- command(tid 0: {"prefix": "status"}) -- 0x5582bfdccb30 con 0x5582bfeea0e0 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.363+0000 7f0d96000640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfeea0e0 0x5582bfee8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0d96000640 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfeea0e0 0x5582bfee8df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=474486acaaba8310 server_cookie=e21aa5177e32795b in_seq=0 out_seq=0 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0d77e00640 10 client.14889 ms_handle_connect on v2:172.21.15.175:6834/1249902842 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0d77e00640 1 -- 172.21.15.144:0/2296847503 <== mds.4 v2:172.21.15.175:6834/1249902842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5582bfdccb30 con 0x5582bfeea0e0 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0d77e00640 10 client.14889 handle_command_reply: tid=0 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 client.14889 shutdown 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 msgr2=0x5582bfe85460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000f790 tx=0x7f0d90005aa0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 shutdown_connections 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x5582bfeea0e0 0x5582bfee8df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582bfe6a510 0x5582bfe64df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582bfe5fc50 0x5582bfe64660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 --2- 172.21.15.144:0/2296847503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582bfe5f330 0x5582bfe85460 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 >> 172.21.15.144:0/2296847503 conn(0x5582bfe5b8c0 msgr2=0x5582bfe5aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.364+0000 7f0d77e00640 0 client.14889 ms_handle_reset on v2:172.21.15.175:6834/1249902842 2024-09-05T07:50:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 shutdown_connections 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0da01e8740 1 -- 172.21.15.144:0/2296847503 wait complete. 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0da01e8740 20 client.14889 trim_cache size 0 max 16384 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 4, 2024-09-05T07:50:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24502, 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 75.019522047999999, 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 117.134071744 2024-09-05T07:50:42.376 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:50:42.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 msgr2=0x7f0d7c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 0x7f0d7c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d880980b0 tx=0x7f0d880d50e0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 msgr2=0x7f0d981a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e9f0 tx=0x7f0d8800edf0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 shutdown_connections 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f0d7c0a2c90 0x7f0d7c0a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d98077040 0x7f0d981a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d98112a50 0x7f0d9819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 --2- 172.21.15.144:0/3022921637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d98076720 0x7f0d981a4750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.365+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 >> 172.21.15.144:0/3022921637 conn(0x7f0d980ffa50 msgr2=0x7f0d98101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:42.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.366+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 shutdown_connections 2024-09-05T07:50:42.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:42.366+0000 7f0d9d600640 1 -- 172.21.15.144:0/3022921637 wait complete. 2024-09-05T07:50:42.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:42 smithi144 ceph-mon[29535]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:43.062 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:42 smithi175 ceph-mon[34585]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:43.062 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:42 smithi154 ceph-mon[34710]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:43.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.c status 2024-09-05T07:50:43.568 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 -- 172.21.15.144:0/2446964234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58101de0 msgr2=0x7eff581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 --2- 172.21.15.144:0/2446964234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58101de0 0x7eff581021c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff48009900 tx=0x7eff4802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 -- 172.21.15.144:0/2446964234 shutdown_connections 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 --2- 172.21.15.144:0/2446964234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58106f10 0x7eff5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 --2- 172.21.15.144:0/2446964234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58102790 0x7eff581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 --2- 172.21.15.144:0/2446964234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58101de0 0x7eff581021c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 -- 172.21.15.144:0/2446964234 >> 172.21.15.144:0/2446964234 conn(0x7eff580fd8c0 msgr2=0x7eff580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 -- 172.21.15.144:0/2446964234 shutdown_connections 2024-09-05T07:50:44.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.119+0000 7eff5e600640 1 -- 172.21.15.144:0/2446964234 wait complete. 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.120+0000 7eff5e600640 1 Processor -- start 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.120+0000 7eff5e600640 1 -- start start 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 0x7eff580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 0x7eff58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 0x7eff58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff58111f70 con 0x7eff58106f10 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff58111df0 con 0x7eff58101de0 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff5e600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff581120f0 con 0x7eff58102790 2024-09-05T07:50:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 0x7eff58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff57400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 0x7eff580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff56a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 0x7eff58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 0x7eff58074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59920/0 (socket says 172.21.15.144:59920) 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff57400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 0x7eff580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:38250/0 (socket says 172.21.15.144:38250) 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.121+0000 7eff57e00640 1 -- 172.21.15.144:0/4075195428 learned_addr learned my addr 172.21.15.144:0/4075195428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 -- 172.21.15.144:0/4075195428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 msgr2=0x7eff580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 0x7eff580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 -- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 msgr2=0x7eff58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 0x7eff58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 -- 172.21.15.144:0/4075195428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff581a68d0 con 0x7eff58102790 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff56a00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 0x7eff58074a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e9f0 tx=0x7eff4400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff4fe00640 1 -- 172.21.15.144:0/4075195428 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4400cd80 con 0x7eff58102790 2024-09-05T07:50:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff4fe00640 1 -- 172.21.15.144:0/4075195428 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff440035f0 con 0x7eff58102790 2024-09-05T07:50:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff581a6bc0 con 0x7eff58102790 2024-09-05T07:50:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff4fe00640 1 -- 172.21.15.144:0/4075195428 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44010690 con 0x7eff58102790 2024-09-05T07:50:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.122+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff581a7100 con 0x7eff58102790 2024-09-05T07:50:44.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.126+0000 7eff610b3740 1 Processor -- start 2024-09-05T07:50:44.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.126+0000 7eff610b3740 1 -- start start 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115330 0x55da9b115710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b122900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da9b07b0b0 con 0x55da9b115c50 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da9b022ab0 con 0x55da9b115330 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff610b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da9b077070 con 0x55da9b120510 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59932/0 (socket says 172.21.15.144:59932) 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 -- 172.21.15.144:0/2286333954 learned_addr learned my addr 172.21.15.144:0/2286333954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115330 0x55da9b115710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff4fe00640 1 -- 172.21.15.144:0/4075195428 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7eff44003b30 con 0x7eff58102790 2024-09-05T07:50:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 -- 172.21.15.144:0/2286333954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 msgr2=0x55da9b122900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T07:50:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b122900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 -- 172.21.15.144:0/2286333954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115330 msgr2=0x55da9b115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115330 0x55da9b115710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.127+0000 7eff57400640 1 -- 172.21.15.144:0/2286333954 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9b02f4a0 con 0x55da9b115c50 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.128+0000 7eff57400640 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff48009900 tx=0x7eff48005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e4b610f14b039 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.128+0000 7eff4cc00640 1 -- 172.21.15.144:0/2286333954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48040070 con 0x55da9b115c50 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.128+0000 7eff4cc00640 1 -- 172.21.15.144:0/2286333954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff480317b0 con 0x55da9b115c50 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.128+0000 7eff4cc00640 1 -- 172.21.15.144:0/2286333954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48035040 con 0x55da9b115c50 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff4fe00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 0x7eff3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 -- 172.21.15.144:0/2286333954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 msgr2=0x55da9b11ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff48009900 tx=0x7eff48005be0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff4fe00640 1 -- 172.21.15.144:0/4075195428 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7eff440cf520 con 0x7eff58102790 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 -- 172.21.15.144:0/2286333954 shutdown_connections 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11ffd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 --2- 172.21.15.144:0/2286333954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115330 0x55da9b115710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 -- 172.21.15.144:0/2286333954 >> 172.21.15.144:0/2286333954 conn(0x55da9b1118c0 msgr2=0x55da9b111ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff57e00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 0x7eff3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 -- 172.21.15.144:0/2286333954 shutdown_connections 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.129+0000 7eff610b3740 1 -- 172.21.15.144:0/2286333954 wait complete. 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff57e00640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 0x7eff3c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff500049d0 tx=0x7eff50009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 -- start start 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 Processor -- start 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 0x55da9b11df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da9b123180 con 0x55da9b115c50 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da9b003920 con 0x55da9b120510 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da9b123300 con 0x55da9b115330 2024-09-05T07:50:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.130+0000 7eff610b3740 10 client.0 _ll_register_callbacks cb 0x55da9b0278a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59946/0 (socket says 172.21.15.144:59946) 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 -- 172.21.15.144:0/3057978802 learned_addr learned my addr 172.21.15.144:0/3057978802 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff57400640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff57e00640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 0x55da9b11df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 -- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 msgr2=0x55da9b11d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 -- 172.21.15.144:0/3057978802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 msgr2=0x55da9b11df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 0x55da9b11df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 -- 172.21.15.144:0/3057978802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9adec2b0 con 0x55da9b115c50 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff57e00640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 0x55da9b11df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff56a00640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff44098010 tx=0x7eff4409c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4847f91db981118 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.131+0000 7eff41600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4409ff60 con 0x55da9b115c50 2024-09-05T07:50:44.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7eff44098220 con 0x55da9b115c50 2024-09-05T07:50:44.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff480317b0 con 0x55da9b115c50 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff440a4820 con 0x55da9b115c50 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff610b3740 10 client.14901 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da9b12ef60 con 0x55da9b115c50 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff480317b0 con 0x55da9b115c50 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff4409b000 con 0x55da9b115c50 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff610b3740 10 client.14901 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.132+0000 7eff610b3740 10 client.14901 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.133+0000 7eff610b3740 20 client.14901 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.133+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b131510 0x55da9b132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.133+0000 7eff610b3740 4 client.14901 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.133+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 --> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da9b088620 con 0x55da9b131510 2024-09-05T07:50:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.133+0000 7eff57400640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b131510 0x55da9b132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.134+0000 7eff57400640 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b131510 0x55da9b132980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a578a01d0ecfd64e server_cookie=50258390dd2c93b9 in_seq=0 out_seq=0 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.134+0000 7eff41600640 10 client.14901 ms_handle_connect on v2:172.21.15.175:6836/470737720 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.134+0000 7eff41600640 1 -- 172.21.15.144:0/3057978802 <== mds.3 v2:172.21.15.175:6836/470737720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da9b088620 con 0x55da9b131510 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.134+0000 7eff41600640 10 client.14901 handle_command_reply: tid=0 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.134+0000 7eff610b3740 1 client.14901 shutdown 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 msgr2=0x55da9b11da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff44098010 tx=0x7eff4409c2b0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 shutdown_connections 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b120510 0x55da9b11df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b131510 0x55da9b132980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115c50 0x55da9b11da20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 --2- 172.21.15.144:0/3057978802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 >> 172.21.15.144:0/3057978802 conn(0x55da9b1118c0 msgr2=0x55da9b1175f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff41600640 0 client.14901 ms_handle_reset on v2:172.21.15.175:6836/470737720 2024-09-05T07:50:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 shutdown_connections 2024-09-05T07:50:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 1 -- 172.21.15.144:0/3057978802 wait complete. 2024-09-05T07:50:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.135+0000 7eff610b3740 20 client.14901 trim_cache size 0 max 16384 2024-09-05T07:50:44.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.153+0000 7eff610b3740 1 Processor -- start 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.153+0000 7eff610b3740 1 -- start start 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.153+0000 7eff610b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.153+0000 7eff610b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff610b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b11f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff610b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da9b130cc0 con 0x55da9b115330 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff610b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da9b131390 con 0x55da9b115c50 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff610b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da9b131a60 con 0x55da9b120510 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59958/0 (socket says 172.21.15.144:59958) 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b11f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 -- 172.21.15.144:0/2738999138 learned_addr learned my addr 172.21.15.144:0/2738999138 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff56a00640 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 -- 172.21.15.144:0/2738999138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 msgr2=0x55da9b11f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b11f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 -- 172.21.15.144:0/2738999138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 msgr2=0x55da9b11ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 -- 172.21.15.144:0/2738999138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9b11fe50 con 0x55da9b115330 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.154+0000 7eff57400640 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7eff480096c0 tx=0x7eff48047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9a73496ba4b449 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff43e00640 1 -- 172.21.15.144:0/2738999138 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48040040 con 0x55da9b115330 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff43e00640 1 -- 172.21.15.144:0/2738999138 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff48005600 con 0x55da9b115330 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff43e00640 1 -- 172.21.15.144:0/2738999138 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48035040 con 0x55da9b115330 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 -- 172.21.15.144:0/2738999138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 msgr2=0x55da9b111210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7eff480096c0 tx=0x7eff48047040 comp rx=0 tx=0).stop 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 -- 172.21.15.144:0/2738999138 shutdown_connections 2024-09-05T07:50:44.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b120510 0x55da9b11f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 --2- 172.21.15.144:0/2738999138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b115330 0x55da9b111210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 -- 172.21.15.144:0/2738999138 >> 172.21.15.144:0/2738999138 conn(0x55da9b1118c0 msgr2=0x55da9b11ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.155+0000 7eff610b3740 1 -- 172.21.15.144:0/2738999138 shutdown_connections 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.156+0000 7eff610b3740 1 -- 172.21.15.144:0/2738999138 wait complete. 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.156+0000 7eff610b3740 1 -- start start 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.156+0000 7eff610b3740 1 Processor -- start 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da9b132800 con 0x55da9b120510 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da9b132130 con 0x55da9b115c50 2024-09-05T07:50:44.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da9b132ed0 con 0x55da9b115330 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff610b3740 10 client.0 _ll_register_callbacks cb 0x7eff4409b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59966/0 (socket says 172.21.15.144:59966) 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 -- 172.21.15.144:0/3067188917 learned_addr learned my addr 172.21.15.144:0/3067188917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57400640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff56a00640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 -- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 msgr2=0x55da9b11a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 -- 172.21.15.144:0/3067188917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 msgr2=0x55da9b11abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.157+0000 7eff57e00640 1 -- 172.21.15.144:0/3067188917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9b139390 con 0x55da9b120510 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff57e00640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ffd0 tx=0x7eff50004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceaff00dc6d01ab server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff41600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:44.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5002a410 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7eff5002a5b0 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff48005600 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff50039050 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff610b3740 10 client.14907 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da9b19c050 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.158+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff48005600 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff50032a10 con 0x55da9b120510 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 10 client.14907 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 10 client.14907 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 20 client.14907 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b1a0d30 0x55da9b19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 4 client.14907 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:50:44.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 --> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] -- command(tid 0: {"prefix": "status"}) -- 0x55da9b082b30 con 0x55da9b1a0d30 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.159+0000 7eff57400640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b1a0d30 0x55da9b19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff57400640 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b1a0d30 0x55da9b19fa40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=de83b459375f631b server_cookie=ced7701f88a9ec43 in_seq=0 out_seq=0 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff41600640 10 client.14907 ms_handle_connect on v2:172.21.15.175:6836/470737720 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff41600640 1 -- 172.21.15.144:0/3067188917 <== mds.3 v2:172.21.15.175:6836/470737720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da9b082b30 con 0x55da9b1a0d30 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff41600640 10 client.14907 handle_command_reply: tid=0 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 client.14907 shutdown 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 msgr2=0x55da9b11b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ffd0 tx=0x7eff50004ab0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 shutdown_connections 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da9b115c50 0x55da9b11abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x55da9b1a0d30 0x55da9b19fa40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da9b120510 0x55da9b11b120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 --2- 172.21.15.144:0/3067188917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da9b115330 0x55da9b11a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff41600640 0 client.14907 ms_handle_reset on v2:172.21.15.175:6836/470737720 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 >> 172.21.15.144:0/3067188917 conn(0x55da9b1118c0 msgr2=0x55da9b12b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 shutdown_connections 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.160+0000 7eff610b3740 1 -- 172.21.15.144:0/3067188917 wait complete. 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff610b3740 20 client.14907 trim_cache size 0 max 16384 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 3, 2024-09-05T07:50:44.165 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24508, 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 77.825885779000004, 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 116.35746491899999 2024-09-05T07:50:44.166 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 msgr2=0x7eff3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 0x7eff3c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff500049d0 tx=0x7eff50009500 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 msgr2=0x7eff58074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 0x7eff58074a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e9f0 tx=0x7eff4400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 shutdown_connections 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7eff3c0a2c10 0x7eff3c0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff58106f10 0x7eff58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff58102790 0x7eff58074a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 --2- 172.21.15.144:0/4075195428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff58101de0 0x7eff580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.161+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 >> 172.21.15.144:0/4075195428 conn(0x7eff580fd8c0 msgr2=0x7eff580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:44.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.162+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 shutdown_connections 2024-09-05T07:50:44.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:44.162+0000 7eff5e600640 1 -- 172.21.15.144:0/4075195428 wait complete. 2024-09-05T07:50:44.672 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:44 smithi144 ceph-mon[29535]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:44 smithi154 ceph-mon[34710]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:44 smithi175 ceph-mon[34585]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:45.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.a status 2024-09-05T07:50:45.461 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:46.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.027+0000 7ff6b9e00640 1 -- 172.21.15.144:0/2737651153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b4109140 msgr2=0x7ff6b4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.027+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/2737651153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b4109140 0x7ff6b4110cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009900 tx=0x7ff6ac02a410 comp rx=0 tx=0).stop 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 -- 172.21.15.144:0/2737651153 shutdown_connections 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/2737651153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b4109140 0x7ff6b4110cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/2737651153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b41049c0 0x7ff6b4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/2737651153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 -- 172.21.15.144:0/2737651153 >> 172.21.15.144:0/2737651153 conn(0x7ff6b40ffa50 msgr2=0x7ff6b4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 -- 172.21.15.144:0/2737651153 shutdown_connections 2024-09-05T07:50:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.028+0000 7ff6b9e00640 1 -- 172.21.15.144:0/2737651153 wait complete. 2024-09-05T07:50:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 Processor -- start 2024-09-05T07:50:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 -- start start 2024-09-05T07:50:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 0x7ff6b419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b4114150 con 0x7ff6b41049c0 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b4113fd0 con 0x7ff6b4104010 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b9e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b41142d0 con 0x7ff6b4109140 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b2a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59984/0 (socket says 172.21.15.144:59984) 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b2000640 1 -- 172.21.15.144:0/399623891 learned_addr learned my addr 172.21.15.144:0/399623891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.029+0000 7ff6b3400640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 0x7ff6b419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 -- 172.21.15.144:0/399623891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 msgr2=0x7ff6b419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 0x7ff6b419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 -- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 msgr2=0x7ff6b419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 -- 172.21.15.144:0/399623891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b419f620 con 0x7ff6b4104010 2024-09-05T07:50:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2000640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b3400640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 0x7ff6b419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b419a670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400eb00 tx=0x7ff6a400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b8a00640 1 -- 172.21.15.144:0/399623891 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4010430 con 0x7ff6b4104010 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b419f910 con 0x7ff6b4104010 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b8a00640 1 -- 172.21.15.144:0/399623891 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a4010ab0 con 0x7ff6b4104010 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.030+0000 7ff6b8a00640 1 -- 172.21.15.144:0/399623891 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4017bb0 con 0x7ff6b4104010 2024-09-05T07:50:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.031+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b41a71f0 con 0x7ff6b4104010 2024-09-05T07:50:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.033+0000 7ff6bc7f0740 1 Processor -- start 2024-09-05T07:50:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 -- start start 2024-09-05T07:50:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 0x5610a01aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 0x5610a01b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610a010a0b0 con 0x5610a01a4330 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610a00b1ab0 con 0x5610a01af510 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610a0106070 con 0x5610a01a4c50 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6b8a00640 1 -- 172.21.15.144:0/399623891 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff6a4010c60 con 0x7ff6b4104010 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60000/0 (socket says 172.21.15.144:60000) 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6b3400640 1 -- 172.21.15.144:0/283652443 learned_addr learned my addr 172.21.15.144:0/283652443 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.034+0000 7ff6b2000640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 0x5610a01b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 0x5610a01aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 -- 172.21.15.144:0/283652443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 msgr2=0x5610a01aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 0x5610a01aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 -- 172.21.15.144:0/283652443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 msgr2=0x5610a01b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 0x5610a01b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 -- 172.21.15.144:0/283652443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610a00be4a0 con 0x5610a01a4330 2024-09-05T07:50:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b2000640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 0x5610a01b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 0x5610a01aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff6b3400640 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac033000 tx=0x7ff6ac005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1170ba73ba33a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.035+0000 7ff69fe00640 1 -- 172.21.15.144:0/283652443 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac035040 con 0x5610a01a4330 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff69fe00640 1 -- 172.21.15.144:0/283652443 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6ac0317b0 con 0x5610a01a4330 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff69fe00640 1 -- 172.21.15.144:0/283652443 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac03c440 con 0x5610a01a4330 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6b8a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 0x7ff6980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6b8a00640 1 -- 172.21.15.144:0/399623891 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff6a40cfbf0 con 0x7ff6b4104010 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 0x7ff6980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/283652443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 msgr2=0x5610a01a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac033000 tx=0x7ff6ac005d50 comp rx=0 tx=0).stop 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/283652443 shutdown_connections 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01af510 0x5610a01b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4c50 0x5610a01aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/283652443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01a4330 0x5610a01a4710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.036+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/283652443 >> 172.21.15.144:0/283652443 conn(0x5610a01a08c0 msgr2=0x5610a01a0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.037+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/283652443 shutdown_connections 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.037+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/283652443 wait complete. 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.037+0000 7ff6b2a00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 0x7ff6980a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40a49c0 tx=0x7ff6a4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.037+0000 7ff6bc7f0740 1 -- start start 2024-09-05T07:50:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.037+0000 7ff6bc7f0740 1 Processor -- start 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610a01b2060 con 0x5610a01af510 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610a0092920 con 0x5610a01a4c50 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610a01b21e0 con 0x5610a01a4330 2024-09-05T07:50:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6bc7f0740 10 client.0 _ll_register_callbacks cb 0x5610a00b68a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60010/0 (socket says 172.21.15.144:60010) 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6b3400640 1 -- 172.21.15.144:0/1108850428 learned_addr learned my addr 172.21.15.144:0/1108850428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.038+0000 7ff6b2000640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 -- 172.21.15.144:0/1108850428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 msgr2=0x5610a01ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 -- 172.21.15.144:0/1108850428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 msgr2=0x5610a01aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 -- 172.21.15.144:0/1108850428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109fe7b2b0 con 0x5610a01af510 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0096c0 tx=0x7ff6ac003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e795ccfe993a509 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff69cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac035070 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff6ac0315b0 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6ac0317b0 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6ac003610 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6bc7f0740 10 client.14919 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.039+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610a01bddb0 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6ac0317b0 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6ac003cf0 con 0x5610a01af510 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 10 client.14919 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 10 client.14919 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 20 client.14919 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:46.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a01bf100 0x5610a01c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 4 client.14919 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 --> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610a0117620 con 0x5610a01bf100 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.040+0000 7ff6b2000640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a01bf100 0x5610a01c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.041+0000 7ff6b2000640 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a01bf100 0x5610a01c1300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1fa95378cce427a server_cookie=24f461cf3cb1dc0a in_seq=0 out_seq=0 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.041+0000 7ff69cc00640 10 client.14919 ms_handle_connect on v2:172.21.15.144:6840/1329376648 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff69cc00640 1 -- 172.21.15.144:0/1108850428 <== mds.2 v2:172.21.15.144:6840/1329376648 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610a0117620 con 0x5610a01bf100 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff69cc00640 10 client.14919 handle_command_reply: tid=0 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 client.14919 shutdown 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 msgr2=0x5610a01acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0096c0 tx=0x7ff6ac003c60 comp rx=0 tx=0).stop 2024-09-05T07:50:46.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 shutdown_connections 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a01bf100 0x5610a01c1300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01acf90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1108850428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 >> 172.21.15.144:0/1108850428 conn(0x5610a01a08c0 msgr2=0x5610a01a65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff69cc00640 0 client.14919 ms_handle_reset on v2:172.21.15.144:6840/1329376648 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 shutdown_connections 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1108850428 wait complete. 2024-09-05T07:50:46.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.042+0000 7ff6bc7f0740 20 client.14919 trim_cache size 0 max 16384 2024-09-05T07:50:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 Processor -- start 2024-09-05T07:50:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 -- start start 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610a01bf640 con 0x5610a01af510 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610a01bfd10 con 0x5610a01a4c50 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610a01c03e0 con 0x5610a01a4330 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60012/0 (socket says 172.21.15.144:60012) 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6b3400640 1 -- 172.21.15.144:0/1247603524 learned_addr learned my addr 172.21.15.144:0/1247603524 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.061+0000 7ff6b2000640 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 -- 172.21.15.144:0/1247603524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 msgr2=0x5610a01a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 -- 172.21.15.144:0/1247603524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 msgr2=0x5610a01a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 -- 172.21.15.144:0/1247603524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610a01a1550 con 0x5610a01af510 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff6b3400640 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac03f040 tx=0x7ff6ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6a820cad5a12c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff69f400640 1 -- 172.21.15.144:0/1247603524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac035030 con 0x5610a01af510 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff69f400640 1 -- 172.21.15.144:0/1247603524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6ac0046c0 con 0x5610a01af510 2024-09-05T07:50:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.062+0000 7ff69f400640 1 -- 172.21.15.144:0/1247603524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac031b70 con 0x5610a01af510 2024-09-05T07:50:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1247603524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 msgr2=0x5610a01c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac03f040 tx=0x7ff6ac02a410 comp rx=0 tx=0).stop 2024-09-05T07:50:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1247603524 shutdown_connections 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01c95e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/1247603524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1247603524 >> 172.21.15.144:0/1247603524 conn(0x5610a01a08c0 msgr2=0x5610a01aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1247603524 shutdown_connections 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.063+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/1247603524 wait complete. 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 -- start start 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 Processor -- start 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610a01c1180 con 0x5610a01af510 2024-09-05T07:50:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610a01c0ab0 con 0x5610a01a4c50 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610a01c1850 con 0x5610a01a4330 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.064+0000 7ff6bc7f0740 10 client.0 _ll_register_callbacks cb 0x7ff6ac03c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60024/0 (socket says 172.21.15.144:60024) 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 -- 172.21.15.144:0/3587507882 learned_addr learned my addr 172.21.15.144:0/3587507882 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 -- 172.21.15.144:0/3587507882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 msgr2=0x5610a01a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 -- 172.21.15.144:0/3587507882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 msgr2=0x5610a01a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 -- 172.21.15.144:0/3587507882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610a01c7ea0 con 0x5610a01af510 2024-09-05T07:50:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b2000640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff6b3400640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac005c40 tx=0x7ff6ac0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41a28bd726c8bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.065+0000 7ff69cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac003e70 con 0x5610a01af510 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff6ac03c5b0 con 0x5610a01af510 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6ac0046c0 con 0x5610a01af510 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6ac03c7b0 con 0x5610a01af510 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 10 client.14925 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610a02332a0 con 0x5610a01af510 2024-09-05T07:50:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6ac0046c0 con 0x5610a01af510 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6ac057ad0 con 0x5610a01af510 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 10 client.14925 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 10 client.14925 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.066+0000 7ff6bc7f0740 20 client.14925 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a0237730 0x5610a0236440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff6bc7f0740 4 client.14925 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 --> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] -- command(tid 0: {"prefix": "status"}) -- 0x5610a0111b30 con 0x5610a0237730 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff6b2000640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a0237730 0x5610a0236440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff6b2000640 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a0237730 0x5610a0236440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a663f35fbe70eff8 server_cookie=cc7af9f08975b341 in_seq=0 out_seq=0 2024-09-05T07:50:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.067+0000 7ff69cc00640 10 client.14925 ms_handle_connect on v2:172.21.15.144:6840/1329376648 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff69cc00640 1 -- 172.21.15.144:0/3587507882 <== mds.2 v2:172.21.15.144:6840/1329376648 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5610a0111b30 con 0x5610a0237730 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff69cc00640 10 client.14925 handle_command_reply: tid=0 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 client.14925 shutdown 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 msgr2=0x5610a01aa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac005c40 tx=0x7ff6ac0095e0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 shutdown_connections 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x5610a0237730 0x5610a0236440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610a01a4c50 0x5610a01a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610a01af510 0x5610a01aa240 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 --2- 172.21.15.144:0/3587507882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610a01a4330 0x5610a01a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff69cc00640 0 client.14925 ms_handle_reset on v2:172.21.15.144:6840/1329376648 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 >> 172.21.15.144:0/3587507882 conn(0x5610a01a08c0 msgr2=0x5610a01ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 shutdown_connections 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 1 -- 172.21.15.144:0/3587507882 wait complete. 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.068+0000 7ff6bc7f0740 20 client.14925 trim_cache size 0 max 16384 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 2, 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24521, 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:50:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 80.740782711999998, 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 105.35490033799999 2024-09-05T07:50:46.074 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 msgr2=0x7ff6980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 0x7ff6980a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40a49c0 tx=0x7ff6a4000f40 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 msgr2=0x7ff6b419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b419a670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400eb00 tx=0x7ff6a400c2d0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 shutdown_connections 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff6980a2c10 0x7ff6980a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b4109140 0x7ff6b419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b41049c0 0x7ff6b419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 --2- 172.21.15.144:0/399623891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4104010 0x7ff6b419a670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 >> 172.21.15.144:0/399623891 conn(0x7ff6b40ffa50 msgr2=0x7ff6b4100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 shutdown_connections 2024-09-05T07:50:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:46.069+0000 7ff6b9e00640 1 -- 172.21.15.144:0/399623891 wait complete. 2024-09-05T07:50:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:46 smithi175 ceph-mon[34585]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:46 smithi154 ceph-mon[34710]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:46.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:46 smithi144 ceph-mon[29535]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:46.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T07:50:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 -- 172.21.15.144:0/1093981851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9984102340 msgr2=0x7f998410e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 --2- 172.21.15.144:0/1093981851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9984102340 0x7f998410e870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f997c009cd0 tx=0x7f997c02a8e0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 -- 172.21.15.144:0/1093981851 shutdown_connections 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 --2- 172.21.15.144:0/1093981851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9984102340 0x7f998410e870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 --2- 172.21.15.144:0/1093981851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99841019a0 0x7f9984101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 --2- 172.21.15.144:0/1093981851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 0x7f9984107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 -- 172.21.15.144:0/1093981851 >> 172.21.15.144:0/1093981851 conn(0x7f99840fd680 msgr2=0x7f99840ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 -- 172.21.15.144:0/1093981851 shutdown_connections 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.855+0000 7f9989e00640 1 -- 172.21.15.144:0/1093981851 wait complete. 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.856+0000 7f9989e00640 1 Processor -- start 2024-09-05T07:50:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.856+0000 7f9989e00640 1 -- start start 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 0x7f998419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 0x7f998419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9984111da0 con 0x7f99841019a0 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9984111c20 con 0x7f99841079a0 2024-09-05T07:50:47.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9984111f20 con 0x7f9984102340 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60044/0 (socket says 172.21.15.144:60044) 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 -- 172.21.15.144:0/1527154177 learned_addr learned my addr 172.21.15.144:0/1527154177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9983e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 0x7f998419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9989400640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 0x7f998419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 -- 172.21.15.144:0/1527154177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 msgr2=0x7f998419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 0x7f998419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 -- 172.21.15.144:0/1527154177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 msgr2=0x7f998419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 0x7f998419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9988a00640 1 -- 172.21.15.144:0/1527154177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998419f400 con 0x7f99841019a0 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.857+0000 7f9983e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 0x7f998419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9988a00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f997800e9f0 tx=0x7f997800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9981600640 1 -- 172.21.15.144:0/1527154177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800cd80 con 0x7f99841019a0 2024-09-05T07:50:47.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9981600640 1 -- 172.21.15.144:0/1527154177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9978010910 con 0x7f99841019a0 2024-09-05T07:50:47.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998419f6f0 con 0x7f99841019a0 2024-09-05T07:50:47.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9981600640 1 -- 172.21.15.144:0/1527154177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978018990 con 0x7f99841019a0 2024-09-05T07:50:47.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.858+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841a6fd0 con 0x7f99841019a0 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.861+0000 7f9981600640 1 -- 172.21.15.144:0/1527154177 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9978010ac0 con 0x7f99841019a0 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.861+0000 7f998e025740 1 Processor -- start 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.861+0000 7f998e025740 1 -- start start 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265fb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265fdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558a265560b0 con 0x558a265f04e0 2024-09-05T07:50:47.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a264fdab0 con 0x558a265f0e00 2024-09-05T07:50:47.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f998e025740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a26552070 con 0x558a265fb6c0 2024-09-05T07:50:47.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9988a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9983e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265fdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60056/0 (socket says 172.21.15.144:60056) 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 -- 172.21.15.144:0/3464219660 learned_addr learned my addr 172.21.15.144:0/3464219660 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 -- 172.21.15.144:0/3464219660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 msgr2=0x558a265fdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265fdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 -- 172.21.15.144:0/3464219660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 msgr2=0x558a265fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265fb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9989400640 1 -- 172.21.15.144:0/3464219660 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a2650a4a0 con 0x558a265f04e0 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.862+0000 7f9988a00640 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9989400640 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f997c009cd0 tx=0x7f997c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70704f9df9369940 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9981600640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 0x7f996c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9975c00640 1 -- 172.21.15.144:0/3464219660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c048070 con 0x558a265f04e0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9975c00640 1 -- 172.21.15.144:0/3464219660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997c036070 con 0x558a265f04e0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9975c00640 1 -- 172.21.15.144:0/3464219660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c004440 con 0x558a265f04e0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9981600640 1 -- 172.21.15.144:0/1527154177 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f99780cf4d0 con 0x7f99841019a0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.863+0000 7f9988a00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 0x7f996c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 -- 172.21.15.144:0/3464219660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 msgr2=0x558a265f08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f9988a00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 0x7f996c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f997800c6a0 tx=0x7f9978000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f997c009cd0 tx=0x7f997c009a20 comp rx=0 tx=0).stop 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 -- 172.21.15.144:0/3464219660 shutdown_connections 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265fdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 --2- 172.21.15.144:0/3464219660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a265f08c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 -- 172.21.15.144:0/3464219660 >> 172.21.15.144:0/3464219660 conn(0x558a265eca70 msgr2=0x558a265ece50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 -- 172.21.15.144:0/3464219660 shutdown_connections 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.864+0000 7f998e025740 1 -- 172.21.15.144:0/3464219660 wait complete. 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 -- start start 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 Processor -- start 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265f04e0 0x558a265f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 0x558a265f9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558a265fe330 con 0x558a265fb6c0 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.865+0000 7f998e025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a264de920 con 0x558a265f0e00 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f998e025740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a265fe4b0 con 0x558a265f04e0 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f998e025740 10 client.0 _ll_register_callbacks cb 0x558a265028a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9989400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265f04e0 0x558a265f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:38380/0 (socket says 172.21.15.144:38380) 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 -- 172.21.15.144:0/2323260553 learned_addr learned my addr 172.21.15.144:0/2323260553 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9989400640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 0x558a265f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 -- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265f04e0 msgr2=0x558a265f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265f04e0 0x558a265f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 -- 172.21.15.144:0/2323260553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 msgr2=0x558a265f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 0x558a265f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 -- 172.21.15.144:0/2323260553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a262c72b0 con 0x558a265f0e00 2024-09-05T07:50:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9989400640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 0x558a265f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f9983e00640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9970012d30 tx=0x7f997000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b683926615f54be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.866+0000 7f996a000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997000fe20 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997c036070 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f9970012110 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9970004050 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f998e025740 10 client.24932 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a2660a0c0 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997c036070 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.867+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9970010430 con 0x558a265f0e00 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 10 client.24932 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 10 client.24932 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 20 client.24932 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2660c6c0 0x558a2660db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 4 client.24932 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 --> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a26563620 con 0x558a2660c6c0 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.868+0000 7f9989400640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2660c6c0 0x558a2660db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.869+0000 7f9989400640 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2660c6c0 0x558a2660db30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f564692550d86330 server_cookie=f650afd47d505fb8 in_seq=0 out_seq=0 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.869+0000 7f996a000640 10 client.24932 ms_handle_connect on v2:172.21.15.175:6838/571012615 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.869+0000 7f996a000640 1 -- 172.21.15.144:0/2323260553 <== mds.1 v2:172.21.15.175:6838/571012615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a26563620 con 0x558a2660c6c0 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.869+0000 7f996a000640 10 client.24932 handle_command_reply: tid=0 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 client.24932 shutdown 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 msgr2=0x558a265f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9970012d30 tx=0x7f997000f790 comp rx=0 tx=0).stop 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 shutdown_connections 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f8b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2660c6c0 0x558a2660db30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265fb6c0 0x558a265f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 --2- 172.21.15.144:0/2323260553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265f04e0 0x558a265f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 >> 172.21.15.144:0/2323260553 conn(0x558a265eca70 msgr2=0x558a265ebbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f996a000640 0 client.24932 ms_handle_reset on v2:172.21.15.175:6838/571012615 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 shutdown_connections 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 1 -- 172.21.15.144:0/2323260553 wait complete. 2024-09-05T07:50:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.870+0000 7f998e025740 20 client.24932 trim_cache size 0 max 16384 2024-09-05T07:50:47.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.888+0000 7f998e025740 1 Processor -- start 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 -- start start 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265ece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558a2660be70 con 0x558a265f04e0 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a2660c540 con 0x558a265f0e00 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f998e025740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a2660cc10 con 0x558a265fb6c0 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60072/0 (socket says 172.21.15.144:60072) 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 -- 172.21.15.144:0/2917348463 learned_addr learned my addr 172.21.15.144:0/2917348463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9983e00640 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 -- 172.21.15.144:0/2917348463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 msgr2=0x558a265ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 -- 172.21.15.144:0/2917348463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 msgr2=0x558a265f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.889+0000 7f9989400640 1 -- 172.21.15.144:0/2917348463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a265f7590 con 0x558a265f04e0 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.890+0000 7f9989400640 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ca0 tx=0x7f997c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad606b1af4b085d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.890+0000 7f9975200640 1 -- 172.21.15.144:0/2917348463 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c048040 con 0x558a265f04e0 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.890+0000 7f9975200640 1 -- 172.21.15.144:0/2917348463 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997c036040 con 0x558a265f04e0 2024-09-05T07:50:47.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.890+0000 7f9975200640 1 -- 172.21.15.144:0/2917348463 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0047e0 con 0x558a265f04e0 2024-09-05T07:50:47.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- 172.21.15.144:0/2917348463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 msgr2=0x558a2660d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ca0 tx=0x7f997c004a40 comp rx=0 tx=0).stop 2024-09-05T07:50:47.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- 172.21.15.144:0/2917348463 shutdown_connections 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 --2- 172.21.15.144:0/2917348463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a2660d460 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- 172.21.15.144:0/2917348463 >> 172.21.15.144:0/2917348463 conn(0x558a265eca70 msgr2=0x558a26606700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- 172.21.15.144:0/2917348463 shutdown_connections 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- 172.21.15.144:0/2917348463 wait complete. 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 -- start start 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.891+0000 7f998e025740 1 Processor -- start 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558a2660d9b0 con 0x558a265f04e0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a2660d2e0 con 0x558a265f0e00 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a2660e080 con 0x558a265fb6c0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f998e025740 10 client.0 _ll_register_callbacks cb 0x7f9970012910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60078/0 (socket says 172.21.15.144:60078) 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9989400640 1 -- 172.21.15.144:0/2208990648 learned_addr learned my addr 172.21.15.144:0/2208990648 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9989400640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 -- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 msgr2=0x558a265f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 -- 172.21.15.144:0/2208990648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 msgr2=0x558a266164d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9983e00640 1 -- 172.21.15.144:0/2208990648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a265f6040 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.892+0000 7f9989400640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f9983e00640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f52d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970010850 tx=0x7f997000ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9007133f40e76e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f996a000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970035060 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997c036040 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f9970010ac0 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f997002c070 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f998e025740 10 client.24938 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.893+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a26676dd0 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997c036040 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99700039c0 con 0x558a265f0e00 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 10 client.24938 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 10 client.24938 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T07:50:47.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 20 client.24938 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2667b980 0x558a2667a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 4 client.24938 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 --> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] -- command(tid 0: {"prefix": "status"}) -- 0x558a2655db30 con 0x558a2667b980 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.894+0000 7f9989400640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2667b980 0x558a2667a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f9989400640 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2667b980 0x558a2667a690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b3c7680501f66d4 server_cookie=ef7f7fa0f92e0f57 in_seq=0 out_seq=0 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f996a000640 10 client.24938 ms_handle_connect on v2:172.21.15.175:6838/571012615 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f996a000640 1 -- 172.21.15.144:0/2208990648 <== mds.1 v2:172.21.15.175:6838/571012615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558a2655db30 con 0x558a2667b980 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f996a000640 10 client.24938 handle_command_reply: tid=0 2024-09-05T07:50:47.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 client.24938 shutdown 2024-09-05T07:50:47.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 msgr2=0x558a265f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f52d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970010850 tx=0x7f997000ff10 comp rx=0 tx=0).stop 2024-09-05T07:50:47.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 shutdown_connections 2024-09-05T07:50:47.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a265f0e00 0x558a265f52d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x558a2667b980 0x558a2667a690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a265fb6c0 0x558a265f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 --2- 172.21.15.144:0/2208990648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558a265f04e0 0x558a266164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f996a000640 0 client.24938 ms_handle_reset on v2:172.21.15.175:6838/571012615 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 >> 172.21.15.144:0/2208990648 conn(0x558a265eca70 msgr2=0x558a26606f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.895+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 shutdown_connections 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f998e025740 1 -- 172.21.15.144:0/2208990648 wait complete. 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f998e025740 20 client.24938 trim_cache size 0 max 16384 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:50:47.901 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 1, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24523, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 83.579225278999999, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 114.70464238300001 2024-09-05T07:50:47.902 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 msgr2=0x7f996c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 0x7f996c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f997800c6a0 tx=0x7f9978000bc0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 msgr2=0x7f998419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f997800e9f0 tx=0x7f997800eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 shutdown_connections 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f996c0a2c10 0x7f996c0a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99841079a0 0x7f998419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9984102340 0x7f998419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 --2- 172.21.15.144:0/1527154177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99841019a0 0x7f998419a450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:47.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.896+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 >> 172.21.15.144:0/1527154177 conn(0x7f99840fd680 msgr2=0x7f99840fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:47.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.897+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 shutdown_connections 2024-09-05T07:50:47.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:47.897+0000 7f9989e00640 1 -- 172.21.15.144:0/1527154177 wait complete. 2024-09-05T07:50:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:48 smithi154 ceph-mon[34710]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:48.784 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:48 smithi144 ceph-mon[29535]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:48.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T07:50:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:48 smithi175 ceph-mon[34585]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:49.191 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 -- 172.21.15.144:0/1475520864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601034b0 msgr2=0x7f706010b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 --2- 172.21.15.144:0/1475520864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601034b0 0x7f706010b9a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f704c009900 tx=0x7f704c02a480 comp rx=0 tx=0).stop 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 -- 172.21.15.144:0/1475520864 shutdown_connections 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 --2- 172.21.15.144:0/1475520864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706010bfc0 0x7f706010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 --2- 172.21.15.144:0/1475520864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601034b0 0x7f706010b9a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 --2- 172.21.15.144:0/1475520864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f7060102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.751+0000 7f7064c00640 1 -- 172.21.15.144:0/1475520864 >> 172.21.15.144:0/1475520864 conn(0x7f70600fc610 msgr2=0x7f70600fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.752+0000 7f7064c00640 1 -- 172.21.15.144:0/1475520864 shutdown_connections 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.752+0000 7f7064c00640 1 -- 172.21.15.144:0/1475520864 wait complete. 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.752+0000 7f7064c00640 1 Processor -- start 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 -- start start 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70601034b0 0x7f70601987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f706010bfc0 0x7f706019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7060111e10 con 0x7f706010bfc0 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7060111c90 con 0x7f7060102b90 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f7064c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7060111f90 con 0x7f70601034b0 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f705f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f705fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f706010bfc0 0x7f706019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f705ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70601034b0 0x7f70601987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f705f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:38422/0 (socket says 172.21.15.144:38422) 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.753+0000 7f705f400640 1 -- 172.21.15.144:0/579260735 learned_addr learned my addr 172.21.15.144:0/579260735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 -- 172.21.15.144:0/579260735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70601034b0 msgr2=0x7f70601987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70601034b0 0x7f70601987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 -- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f706010bfc0 msgr2=0x7f706019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f706010bfc0 0x7f706019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 -- 172.21.15.144:0/579260735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706019d260 con 0x7f7060102b90 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f705f400640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f7057e00640 1 -- 172.21.15.144:0/579260735 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705000cd80 con 0x7f7060102b90 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f7057e00640 1 -- 172.21.15.144:0/579260735 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7050010910 con 0x7f7060102b90 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706019d550 con 0x7f7060102b90 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.754+0000 7f7057e00640 1 -- 172.21.15.144:0/579260735 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050018990 con 0x7f7060102b90 2024-09-05T07:50:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.755+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70601a4e30 con 0x7f7060102b90 2024-09-05T07:50:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.758+0000 7f7057e00640 1 -- 172.21.15.144:0/579260735 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7050010ac0 con 0x7f7060102b90 2024-09-05T07:50:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.758+0000 7f7068dc8740 1 Processor -- start 2024-09-05T07:50:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 -- start start 2024-09-05T07:50:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0a8ad0 0x5615ea0aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5615e9fff0b0 con 0x5615ea0993e0 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615e9fa6ab0 con 0x5615ea099d00 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f7068dc8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615e9ffb070 con 0x5615ea0a8ad0 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:38436/0 (socket says 172.21.15.144:38436) 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60110/0 (socket says 172.21.15.144:60110) 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705f400640 1 -- 172.21.15.144:0/3829586793 learned_addr learned my addr 172.21.15.144:0/3829586793 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.759+0000 7f705ea00640 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0a8ad0 0x5615ea0aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 -- 172.21.15.144:0/3829586793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0a8ad0 msgr2=0x5615ea0aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0a8ad0 0x5615ea0aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f7057e00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 0x7f70440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 -- 172.21.15.144:0/3829586793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 msgr2=0x5615ea0997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 -- 172.21.15.144:0/3829586793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e9fb34a0 con 0x5615ea099d00 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f7057e00640 1 -- 172.21.15.144:0/579260735 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f70500cf4b0 con 0x7f7060102b90 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f705f400640 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70500ccd30 tx=0x7f7050097cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7476ebd088ebfa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f704be00640 1 -- 172.21.15.144:0/3829586793 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050026030 con 0x5615ea099d00 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f704be00640 1 -- 172.21.15.144:0/3829586793 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7050086030 con 0x5615ea099d00 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.760+0000 7f704be00640 1 -- 172.21.15.144:0/3829586793 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705009bbf0 con 0x5615ea099d00 2024-09-05T07:50:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.761+0000 7f705fe00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 0x7f70440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.761+0000 7f7068dc8740 1 -- 172.21.15.144:0/3829586793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 msgr2=0x5615ea0a8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.761+0000 7f705fe00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 0x7f70440a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7058005c40 tx=0x7f7058004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.761+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70500ccd30 tx=0x7f7050097cc0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 -- 172.21.15.144:0/3829586793 shutdown_connections 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea099d00 0x5615ea0a8590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0a8ad0 0x5615ea0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3829586793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 -- 172.21.15.144:0/3829586793 >> 172.21.15.144:0/3829586793 conn(0x5615ea095a70 msgr2=0x5615ea095e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 -- 172.21.15.144:0/3829586793 shutdown_connections 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 -- 172.21.15.144:0/3829586793 wait complete. 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 -- start start 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.762+0000 7f7068dc8740 1 Processor -- start 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 0x5615ea0a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0ab7a0 con 0x5615ea0a8ad0 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615e9f87920 con 0x5615ea0993e0 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0ab920 con 0x5615ea099d00 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f7068dc8740 10 client.0 _ll_register_callbacks cb 0x5615e9fab8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f705fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f705f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 0x5615ea0a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f705ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f705fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60112/0 (socket says 172.21.15.144:60112) 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.763+0000 7f705fe00640 1 -- 172.21.15.144:0/2811854452 learned_addr learned my addr 172.21.15.144:0/2811854452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 -- 172.21.15.144:0/2811854452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 msgr2=0x5615ea0a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 -- 172.21.15.144:0/2811854452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 msgr2=0x5615ea0a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 -- 172.21.15.144:0/2811854452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e9d702b0 con 0x5615ea0993e0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f705f400640 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 0x5615ea0a5a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70500cce20 tx=0x7f7050018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e68f3097edf0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7048c00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:50:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705009b9c0 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7050086030 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f7050098260 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f705009b730 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7068dc8740 10 client.24950 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.764+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615ea0b7530 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7050086030 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70500cd040 con 0x5615ea0993e0 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 10 client.24950 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 10 client.24950 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 20 client.24950 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea0b8880 0x5615ea0ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 4 client.24950 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:50:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615ea00c620 con 0x5615ea0b8880 2024-09-05T07:50:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.765+0000 7f705ea00640 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea0b8880 0x5615ea0ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.766+0000 7f705ea00640 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea0b8880 0x5615ea0ba9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24788aa7b9cc73a0 server_cookie=f31ba5cb6bd8dad4 in_seq=0 out_seq=0 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.766+0000 7f7048c00640 10 client.24950 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7048c00640 1 -- 172.21.15.144:0/2811854452 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615ea00c620 con 0x5615ea0b8880 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7048c00640 10 client.24950 handle_command_reply: tid=0 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 client.24950 shutdown 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 msgr2=0x5615ea0a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 0x5615ea0a5a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70500cce20 tx=0x7f7050018420 comp rx=0 tx=0).stop 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 shutdown_connections 2024-09-05T07:50:49.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea0b8880 0x5615ea0ba9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 --2- 172.21.15.144:0/2811854452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0993e0 0x5615ea0a5a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7048c00640 0 client.24950 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 >> 172.21.15.144:0/2811854452 conn(0x5615ea095a70 msgr2=0x5615ea09b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 shutdown_connections 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 1 -- 172.21.15.144:0/2811854452 wait complete. 2024-09-05T07:50:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.767+0000 7f7068dc8740 20 client.24950 trim_cache size 0 max 16384 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 Processor -- start 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 -- start start 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0b8d00 con 0x5615ea0993e0 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0b93d0 con 0x5615ea0a8ad0 2024-09-05T07:50:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.786+0000 7f7068dc8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0b9aa0 con 0x5615ea099d00 2024-09-05T07:50:49.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36524/0 (socket says 172.21.15.144:36524) 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 -- 172.21.15.144:0/3511923172 learned_addr learned my addr 172.21.15.144:0/3511923172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705fe00640 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 -- 172.21.15.144:0/3511923172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 msgr2=0x5615ea0a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 -- 172.21.15.144:0/3511923172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 msgr2=0x5615ea0b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0b9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 -- 172.21.15.144:0/3511923172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea09aa10 con 0x5615ea099d00 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705fe00640 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.787+0000 7f705ea00640 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f704c009900 tx=0x7f704c005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2f22f2b083d659 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.788+0000 7f704b400640 1 -- 172.21.15.144:0/3511923172 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c035040 con 0x5615ea099d00 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.788+0000 7f704b400640 1 -- 172.21.15.144:0/3511923172 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f704c04b070 con 0x5615ea099d00 2024-09-05T07:50:49.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.788+0000 7f704b400640 1 -- 172.21.15.144:0/3511923172 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c0315b0 con 0x5615ea099d00 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.788+0000 7f7068dc8740 1 -- 172.21.15.144:0/3511923172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 msgr2=0x5615ea0a2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.788+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f704c009900 tx=0x7f704c005b50 comp rx=0 tx=0).stop 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 -- 172.21.15.144:0/3511923172 shutdown_connections 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea099d00 0x5615ea0a2ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 --2- 172.21.15.144:0/3511923172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea0993e0 0x5615ea0b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 -- 172.21.15.144:0/3511923172 >> 172.21.15.144:0/3511923172 conn(0x5615ea095a70 msgr2=0x5615ea0a4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 -- 172.21.15.144:0/3511923172 shutdown_connections 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 -- 172.21.15.144:0/3511923172 wait complete. 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 -- start start 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.789+0000 7f7068dc8740 1 Processor -- start 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0ba840 con 0x5615ea099d00 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0ba170 con 0x5615ea0a8ad0 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0baf10 con 0x5615ea0993e0 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f7068dc8740 10 client.0 _ll_register_callbacks cb 0x7f70500d5480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:50:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60132/0 (socket says 172.21.15.144:60132) 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36530/0 (socket says 172.21.15.144:36530) 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705ea00640 1 -- 172.21.15.144:0/1222311755 learned_addr learned my addr 172.21.15.144:0/1222311755 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.790+0000 7f705fe00640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 -- 172.21.15.144:0/1222311755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 msgr2=0x5615ea0a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 -- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 msgr2=0x5615ea0a3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 -- 172.21.15.144:0/1222311755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea0c11b0 con 0x5615ea099d00 2024-09-05T07:50:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705f400640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f705ea00640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f704c02a9a0 tx=0x7f704c005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca151562340cb41a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f7048c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c053070 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f704c0048c0 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f704c04b070 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.791+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f704c035040 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 10 client.14961 fetch_fsmap learned FSMap version 28 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615ea123fe0 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f704c04b070 con 0x5615ea099d00 2024-09-05T07:50:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70500d5d20 con 0x5615ea099d00 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 10 client.14961 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 10 client.14961 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 20 client.14961 populate_metadata read hostname 'smithi144' 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea128670 0x5615ea127380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 4 client.14961 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.792+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "status"}) -- 0x5615ea006b30 con 0x5615ea128670 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f705f400640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea128670 0x5615ea127380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f705f400640 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea128670 0x5615ea127380 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e150e0ad86a28c server_cookie=c5f09051516685f0 in_seq=0 out_seq=0 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f7048c00640 10 client.14961 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f7048c00640 1 -- 172.21.15.144:0/1222311755 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5615ea006b30 con 0x5615ea128670 2024-09-05T07:50:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f7048c00640 10 client.14961 handle_command_reply: tid=0 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.793+0000 7f7068dc8740 1 client.14961 shutdown 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 msgr2=0x5615ea0a3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f704c02a9a0 tx=0x7f704c005890 comp rx=0 tx=0).stop 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 shutdown_connections 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5615ea128670 0x5615ea127380 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea0a8ad0 0x5615ea0a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5615ea099d00 0x5615ea0a3140 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 --2- 172.21.15.144:0/1222311755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615ea0993e0 0x5615ea0a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 >> 172.21.15.144:0/1222311755 conn(0x5615ea095a70 msgr2=0x5615ea09af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7048c00640 0 client.14961 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:50:49.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 shutdown_connections 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 1 -- 172.21.15.144:0/1222311755 wait complete. 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.794+0000 7f7068dc8740 20 client.14961 trim_cache size 0 max 16384 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24533, 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:50:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 93.843787977999995, 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 106.36458483200001 2024-09-05T07:50:49.800 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:50:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 msgr2=0x7f70440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 0x7f70440a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7058005c40 tx=0x7f7058004ab0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 msgr2=0x7f70601982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 shutdown_connections 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f70440a2c90 0x7f70440a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f706010bfc0 0x7f706019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70601034b0 0x7f70601987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 --2- 172.21.15.144:0/579260735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7060102b90 0x7f70601982b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 >> 172.21.15.144:0/579260735 conn(0x7f70600fc610 msgr2=0x7f70600fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 shutdown_connections 2024-09-05T07:50:49.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:49.795+0000 7f7064c00640 1 -- 172.21.15.144:0/579260735 wait complete. 2024-09-05T07:50:50.572 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:50 smithi144 ceph-mon[29535]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:50 smithi154 ceph-mon[34710]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:50.792 INFO:tasks.cephadm:Setup complete, yielding 2024-09-05T07:50:50.792 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T07:50:50.805 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:50:50.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch status' 2024-09-05T07:50:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:50 smithi175 ceph-mon[34585]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:51.188 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 -- 172.21.15.144:0/2551229874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc100280 msgr2=0x7f13bc1073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 --2- 172.21.15.144:0/2551229874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc100280 0x7f13bc1073f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009900 tx=0x7f13a802a410 comp rx=0 tx=0).stop 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 -- 172.21.15.144:0/2551229874 shutdown_connections 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 --2- 172.21.15.144:0/2551229874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc107930 0x7f13bc109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 --2- 172.21.15.144:0/2551229874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc100280 0x7f13bc1073f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 --2- 172.21.15.144:0/2551229874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc0ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 -- 172.21.15.144:0/2551229874 >> 172.21.15.144:0/2551229874 conn(0x7f13bc0fb610 msgr2=0x7f13bc0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 -- 172.21.15.144:0/2551229874 shutdown_connections 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.736+0000 7f13c3400640 1 -- 172.21.15.144:0/2551229874 wait complete. 2024-09-05T07:50:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 Processor -- start 2024-09-05T07:50:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 -- start start 2024-09-05T07:50:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc100280 0x7f13bc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc107930 0x7f13bc1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10d860 con 0x7f13bc107930 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10d6e0 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.737+0000 7f13c3400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10d9e0 con 0x7f13bc100280 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc107930 0x7f13bc1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:38484/0 (socket says 172.21.15.144:38484) 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 -- 172.21.15.144:0/1388786684 learned_addr learned my addr 172.21.15.144:0/1388786684 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13bbe00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc100280 0x7f13bc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:51.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 -- 172.21.15.144:0/1388786684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc100280 msgr2=0x7f13bc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc100280 0x7f13bc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 -- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc107930 msgr2=0x7f13bc1a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc107930 0x7f13bc1a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 -- 172.21.15.144:0/1388786684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc1a1d60 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.738+0000 7f13c0a00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9f0 tx=0x7f13ac00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.739+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00cd80 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.739+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13ac005500 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.739+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc1a1ff0 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.739+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac010690 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.739+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1a2450 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.740+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc1a26e0 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.742+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f13ac0046c0 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.743+0000 7f13b9600640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 0x7f13a00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.743+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f13ac0cf640 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.743+0000 7f13bbe00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 0x7f13a00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.744+0000 7f13bbe00640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 0x7f13a00a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13a80314e0 tx=0x7f13a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:51.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.747+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13ac09c3d0 con 0x7f13bc0ff8b0 2024-09-05T07:50:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.937+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f13bc1a28b0 con 0x7f13a00a2c40 2024-09-05T07:50:51.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.938+0000 7f13b9600640 1 -- 172.21.15.144:0/1388786684 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f13bc1a28b0 con 0x7f13a00a2c40 2024-09-05T07:50:51.939 INFO:teuthology.orchestra.run.smithi144.stdout:Backend: cephadm 2024-09-05T07:50:51.939 INFO:teuthology.orchestra.run.smithi144.stdout:Available: Yes 2024-09-05T07:50:51.939 INFO:teuthology.orchestra.run.smithi144.stdout:Paused: No 2024-09-05T07:50:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 msgr2=0x7f13a00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 0x7f13a00a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13a80314e0 tx=0x7f13a8000bc0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 msgr2=0x7f13bc19a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9f0 tx=0x7f13ac00edf0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 shutdown_connections 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f13a00a2c40 0x7f13a00a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc107930 0x7f13bc1a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc100280 0x7f13bc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 --2- 172.21.15.144:0/1388786684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0ff8b0 0x7f13bc19a130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 >> 172.21.15.144:0/1388786684 conn(0x7f13bc0fb610 msgr2=0x7f13bc0fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 shutdown_connections 2024-09-05T07:50:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:51.941+0000 7f13c3400640 1 -- 172.21.15.144:0/1388786684 wait complete. 2024-09-05T07:50:52.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:52 smithi144 ceph-mon[29535]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:52 smithi154 ceph-mon[34710]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:52.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-05T07:50:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:52 smithi175 ceph-mon[34585]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:50:53.149 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:53.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:53 smithi144 ceph-mon[29535]: from='client.24962 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:53.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:53 smithi154 ceph-mon[34710]: from='client.24962 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 -- 172.21.15.144:0/4017911442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80105810 msgr2=0x7fcf8010c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 --2- 172.21.15.144:0/4017911442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80105810 0x7fcf8010c0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ca0 tx=0x7fcf7802a8b0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 -- 172.21.15.144:0/4017911442 shutdown_connections 2024-09-05T07:50:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 --2- 172.21.15.144:0/4017911442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80105810 0x7fcf8010c0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 --2- 172.21.15.144:0/4017911442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf801052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 --2- 172.21.15.144:0/4017911442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80103c50 0x7fcf80104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 -- 172.21.15.144:0/4017911442 >> 172.21.15.144:0/4017911442 conn(0x7fcf800ff3e0 msgr2=0x7fcf80101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 -- 172.21.15.144:0/4017911442 shutdown_connections 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.705+0000 7fcf86e00640 1 -- 172.21.15.144:0/4017911442 wait complete. 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 Processor -- start 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 -- start start 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 0x7fcf80199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80105810 0x7fcf801a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010f900 con 0x7fcf80104e50 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010f780 con 0x7fcf80103c50 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.706+0000 7fcf86e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010fa80 con 0x7fcf80105810 2024-09-05T07:50:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 0x7fcf80199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59330/0 (socket says 172.21.15.144:59330) 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85000640 1 -- 172.21.15.144:0/3710590469 learned_addr learned my addr 172.21.15.144:0/3710590469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf86400640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80105810 0x7fcf801a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 -- 172.21.15.144:0/3710590469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80105810 msgr2=0x7fcf801a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80105810 0x7fcf801a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 -- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 msgr2=0x7fcf8019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 -- 172.21.15.144:0/3710590469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf801a1af0 con 0x7fcf80103c50 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85000640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.707+0000 7fcf85a00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 0x7fcf80199ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e9c0 tx=0x7fcf7400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.708+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400ccc0 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.708+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf740035f0 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.708+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf801a1de0 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.708+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400ce60 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.708+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801a2290 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.709+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8010b000 con 0x7fcf80103c50 2024-09-05T07:50:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.711+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcf740037a0 con 0x7fcf80103c50 2024-09-05T07:50:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.712+0000 7fcf7e000640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 0x7fcf680a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.712+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fcf740cf520 con 0x7fcf80103c50 2024-09-05T07:50:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.712+0000 7fcf85000640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 0x7fcf680a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.713+0000 7fcf85000640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 0x7fcf680a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf8019b3e0 tx=0x7fcf6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.714+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf7409c2b0 con 0x7fcf80103c50 2024-09-05T07:50:53.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:53 smithi175 ceph-mon[34585]: from='client.24962 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:53.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.897+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcf80062630 con 0x7fcf680a2cc0 2024-09-05T07:50:53.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.909+0000 7fcf7e000640 1 -- 172.21.15.144:0/3710590469 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fcf80062630 con 0x7fcf680a2cc0 2024-09-05T07:50:53.910 INFO:teuthology.orchestra.run.smithi144.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-05T07:50:53.910 INFO:teuthology.orchestra.run.smithi144.stdout:mds.a smithi144 running (113s) 26s ago 113s 16.5M - 19.1.1-259-g91c8a7e5 77770cf7e895 31e60f2d4633 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.b smithi154 running (110s) 41s ago 110s 26.3M - 19.1.1-259-g91c8a7e5 77770cf7e895 d31e1ed2906c 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.c smithi175 running (2m) 41s ago 2m 19.2M - 19.1.1-259-g91c8a7e5 77770cf7e895 7768834dd0f8 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.d smithi144 running (2m) 26s ago 2m 15.2M - 19.1.1-259-g91c8a7e5 77770cf7e895 27f4e54f12ee 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.e smithi154 running (2m) 41s ago 2m 16.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 4ac63d4a6a53 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.f smithi175 running (2m) 41s ago 2m 17.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 18b5423e506b 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.g smithi144 running (117s) 26s ago 117s 12.6M - 19.1.1-259-g91c8a7e5 77770cf7e895 a1cce3d75dec 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.h smithi154 running (2m) 41s ago 2m 17.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 a952dfd077cf 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.i smithi175 running (2m) 41s ago 2m 17.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 4a303aa159cb 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.j smithi144 running (2m) 26s ago 2m 12.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 1d7edf6a9103 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.k smithi154 running (2m) 41s ago 2m 16.3M - 19.1.1-259-g91c8a7e5 77770cf7e895 e5e4b0a26e9a 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mds.l smithi175 running (2m) 41s ago 2m 17.0M - 19.1.1-259-g91c8a7e5 77770cf7e895 ac38318634da 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mgr.x smithi144 *:9283,8765 running (9m) 26s ago 9m 509M - 19.1.1-259-g91c8a7e5 77770cf7e895 bad279691286 2024-09-05T07:50:53.911 INFO:teuthology.orchestra.run.smithi144.stdout:mgr.y smithi154 *:8443,8765 running (7m) 41s ago 7m 441M - 19.1.1-259-g91c8a7e5 77770cf7e895 7cbf6e0b8d0e 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:mgr.z smithi175 *:8443,8765 running (7m) 41s ago 7m 442M - 19.1.1-259-g91c8a7e5 77770cf7e895 d797f555f2ef 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:mon.a smithi144 running (9m) 26s ago 9m 47.7M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 465f9df2cc5d 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:mon.b smithi154 running (8m) 41s ago 8m 42.2M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 2bbf37beacbb 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:mon.c smithi175 running (8m) 41s ago 8m 40.4M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 0b0e6120c976 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:osd.0 smithi144 running (7m) 26s ago 7m 54.8M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 4c45f66758b3 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:osd.1 smithi154 running (7m) 41s ago 7m 57.0M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 1862267db187 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:osd.2 smithi175 running (6m) 41s ago 6m 57.6M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 32ce4d428d4a 2024-09-05T07:50:53.912 INFO:teuthology.orchestra.run.smithi144.stdout:osd.3 smithi144 running (6m) 26s ago 6m 54.0M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 59e2c52bfac0 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.4 smithi154 running (5m) 41s ago 5m 42.4M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 dc90a6560733 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.5 smithi175 running (5m) 41s ago 5m 43.9M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 8eeed516a5da 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.6 smithi144 running (4m) 26s ago 4m 50.8M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 f815725204fc 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.7 smithi154 running (4m) 41s ago 4m 57.9M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 354db11f992c 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.8 smithi175 running (4m) 41s ago 4m 53.8M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 937261c364a7 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.9 smithi144 running (3m) 26s ago 3m 40.6M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 d5be7492d0bd 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.10 smithi154 running (3m) 41s ago 3m 42.1M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 e156d7359bd6 2024-09-05T07:50:53.913 INFO:teuthology.orchestra.run.smithi144.stdout:osd.11 smithi175 running (2m) 41s ago 2m 41.3M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 3c11ecccf2a0 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 msgr2=0x7fcf680a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 0x7fcf680a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf8019b3e0 tx=0x7fcf6c005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 msgr2=0x7fcf80199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 0x7fcf80199ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e9c0 tx=0x7fcf7400ee80 comp rx=0 tx=0).stop 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 shutdown_connections 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fcf680a2cc0 0x7fcf680a5180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf80105810 0x7fcf801a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf80104e50 0x7fcf8019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 --2- 172.21.15.144:0/3710590469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf80103c50 0x7fcf80199ec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:53.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 >> 172.21.15.144:0/3710590469 conn(0x7fcf800ff3e0 msgr2=0x7fcf801081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:53.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 shutdown_connections 2024-09-05T07:50:53.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:53.912+0000 7fcf86e00640 1 -- 172.21.15.144:0/3710590469 wait complete. 2024-09-05T07:50:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:54 smithi154 ceph-mon[34710]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:54.774 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:54 smithi144 ceph-mon[29535]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:54.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-05T07:50:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:54 smithi175 ceph-mon[34585]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:50:55.180 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:55.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:55 smithi144 ceph-mon[29535]: from='client.24968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:55.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:55 smithi154 ceph-mon[34710]: from='client.24968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 -- 172.21.15.144:0/2666631211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc1037c0 msgr2=0x7efbfc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 --2- 172.21.15.144:0/2666631211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc1037c0 0x7efbfc10a050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009ca0 tx=0x7efbf402a8c0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 -- 172.21.15.144:0/2666631211 shutdown_connections 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 --2- 172.21.15.144:0/2666631211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc102e00 0x7efbfc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 --2- 172.21.15.144:0/2666631211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc1037c0 0x7efbfc10a050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 --2- 172.21.15.144:0/2666631211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc101c00 0x7efbfc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 -- 172.21.15.144:0/2666631211 >> 172.21.15.144:0/2666631211 conn(0x7efbfc0fd390 msgr2=0x7efbfc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 -- 172.21.15.144:0/2666631211 shutdown_connections 2024-09-05T07:50:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.747+0000 7efc00a00640 1 -- 172.21.15.144:0/2666631211 wait complete. 2024-09-05T07:50:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 Processor -- start 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 -- start start 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc101c00 0x7efbfc19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc1037c0 0x7efbfc1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc10d8d0 con 0x7efbfc102e00 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc10d750 con 0x7efbfc101c00 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.748+0000 7efc00a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc10da50 con 0x7efbfc1037c0 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59348/0 (socket says 172.21.15.144:59348) 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 -- 172.21.15.144:0/2305859244 learned_addr learned my addr 172.21.15.144:0/2305859244 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbfa800640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc1037c0 0x7efbfc1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf9e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc101c00 0x7efbfc19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 -- 172.21.15.144:0/2305859244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc1037c0 msgr2=0x7efbfc1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc1037c0 0x7efbfc1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 -- 172.21.15.144:0/2305859244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc101c00 msgr2=0x7efbfc19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc101c00 0x7efbfc19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 -- 172.21.15.144:0/2305859244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1a1cd0 con 0x7efbfc102e00 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.749+0000 7efbf3e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efbe400e9f0 tx=0x7efbe400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.750+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe400cd80 con 0x7efbfc102e00 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.750+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbe4010910 con 0x7efbfc102e00 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.750+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc1a1fc0 con 0x7efbfc102e00 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.750+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4018990 con 0x7efbfc102e00 2024-09-05T07:50:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.750+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc1a2470 con 0x7efbfc102e00 2024-09-05T07:50:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.751+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc1a26a0 con 0x7efbfc102e00 2024-09-05T07:50:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.753+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efbe4010ac0 con 0x7efbfc102e00 2024-09-05T07:50:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.755+0000 7efbf2a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 0x7efbe00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.755+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7efbe40cf4e0 con 0x7efbfc102e00 2024-09-05T07:50:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.755+0000 7efbf9e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 0x7efbe00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:55.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.755+0000 7efbf9e00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 0x7efbe00a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbfc102c60 tx=0x7efbec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.758+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efbe409bc20 con 0x7efbfc102e00 2024-09-05T07:50:55.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:55 smithi175 ceph-mon[34585]: from='client.24968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.941+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7efbfc075b40 con 0x7efbe00a2c40 2024-09-05T07:50:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.947+0000 7efbf2a00640 1 -- 172.21.15.144:0/2305859244 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7efbfc075b40 con 0x7efbe00a2c40 2024-09-05T07:50:55.948 INFO:teuthology.orchestra.run.smithi144.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-05T07:50:55.948 INFO:teuthology.orchestra.run.smithi144.stdout:mds.all 12/12 43s ago 2m smithi144=a;smithi144=d;smithi144=g;smithi144=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-05T07:50:55.948 INFO:teuthology.orchestra.run.smithi144.stdout:mgr 3/3 43s ago 7m smithi144=x;smithi154=y;smithi175=z;count:3 2024-09-05T07:50:55.949 INFO:teuthology.orchestra.run.smithi144.stdout:mon 3/3 43s ago 8m smithi144:172.21.15.144=a;smithi154:172.21.15.154=b;smithi175:172.21.15.175=c;count:3 2024-09-05T07:50:55.949 INFO:teuthology.orchestra.run.smithi144.stdout:osd 12 43s ago - 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 msgr2=0x7efbe00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 0x7efbe00a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbfc102c60 tx=0x7efbec005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 msgr2=0x7efbfc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efbe400e9f0 tx=0x7efbe400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 shutdown_connections 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7efbe00a2c40 0x7efbe00a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efbfc1037c0 0x7efbfc1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc102e00 0x7efbfc19a5e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 --2- 172.21.15.144:0/2305859244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbfc101c00 0x7efbfc19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 >> 172.21.15.144:0/2305859244 conn(0x7efbfc0fd390 msgr2=0x7efbfc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 shutdown_connections 2024-09-05T07:50:55.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:55.950+0000 7efc00a00640 1 -- 172.21.15.144:0/2305859244 wait complete. 2024-09-05T07:50:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:56 smithi154 ceph-mon[34710]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:56.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:56 smithi144 ceph-mon[29535]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:56 smithi175 ceph-mon[34585]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:56.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-05T07:50:57.229 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:57.687 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:57 smithi144 ceph-mon[29535]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:57.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:57 smithi154 ceph-mon[34710]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2772757401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4101a40 msgr2=0x7f9dd4101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2772757401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4101a40 0x7f9dd4101e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009900 tx=0x7f9dc402a410 comp rx=0 tx=0).stop 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2772757401 shutdown_connections 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2772757401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4102c40 0x7f9dd41030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2772757401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4103600 0x7f9dd4109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2772757401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4101a40 0x7f9dd4101e40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2772757401 >> 172.21.15.144:0/2772757401 conn(0x7f9dd40fd1f0 msgr2=0x7f9dd40ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.798+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2772757401 shutdown_connections 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.799+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2772757401 wait complete. 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 Processor -- start 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 -- start start 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4101a40 0x7f9dd4199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4103600 0x7f9dd41a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410d6f0 con 0x7f9dd4102c40 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410d570 con 0x7f9dd4103600 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd8c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410d870 con 0x7f9dd4101a40 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59374/0 (socket says 172.21.15.144:59374) 2024-09-05T07:50:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd2a00640 1 -- 172.21.15.144:0/2754745640 learned_addr learned my addr 172.21.15.144:0/2754745640 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd3400640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4101a40 0x7f9dd4199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.800+0000 7f9dd3e00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4103600 0x7f9dd41a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 -- 172.21.15.144:0/2754745640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4101a40 msgr2=0x7f9dd4199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4101a40 0x7f9dd4199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 -- 172.21.15.144:0/2754745640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4103600 msgr2=0x7f9dd41a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4103600 0x7f9dd41a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 -- 172.21.15.144:0/2754745640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd41a1b40 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd2a00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000cd80 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc0010910 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0018990 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41a1e30 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.801+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41a22e0 con 0x7f9dd4102c40 2024-09-05T07:50:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.802+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd41a2510 con 0x7f9dd4102c40 2024-09-05T07:50:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.805+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9dc0010ac0 con 0x7f9dd4102c40 2024-09-05T07:50:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.806+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 0x7f9db80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.806+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f9dc00cf4e0 con 0x7f9dd4102c40 2024-09-05T07:50:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.806+0000 7f9dd3400640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 0x7f9db80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:57.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.807+0000 7f9dd3400640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 0x7f9db80a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402aa00 tx=0x7f9dc40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:57.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.810+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dc009bc20 con 0x7f9dd4102c40 2024-09-05T07:50:57.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:57 smithi175 ceph-mon[34585]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:57.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.988+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9dd4075b40 con 0x7f9db80a2c40 2024-09-05T07:50:57.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.989+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2754745640 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9dd4075b40 con 0x7f9db80a2c40 2024-09-05T07:50:57.990 INFO:teuthology.orchestra.run.smithi144.stdout:HOST ADDR LABELS STATUS 2024-09-05T07:50:57.990 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144 172.21.15.144 2024-09-05T07:50:57.990 INFO:teuthology.orchestra.run.smithi144.stdout:smithi154 172.21.15.154 2024-09-05T07:50:57.990 INFO:teuthology.orchestra.run.smithi144.stdout:smithi175 172.21.15.175 2024-09-05T07:50:57.991 INFO:teuthology.orchestra.run.smithi144.stdout:3 hosts in cluster 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 msgr2=0x7f9db80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 0x7f9db80a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402aa00 tx=0x7f9dc40315b0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 msgr2=0x7f9dd419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 shutdown_connections 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f9db80a2c40 0x7f9db80a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd4103600 0x7f9dd41a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd4102c40 0x7f9dd419a450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 --2- 172.21.15.144:0/2754745640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dd4101a40 0x7f9dd4199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 >> 172.21.15.144:0/2754745640 conn(0x7f9dd40fd1f0 msgr2=0x7f9dd4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 shutdown_connections 2024-09-05T07:50:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:57.992+0000 7f9dd8c00640 1 -- 172.21.15.144:0/2754745640 wait complete. 2024-09-05T07:50:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:58 smithi154 ceph-mon[34710]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:58.708 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:58 smithi144 ceph-mon[29535]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:58.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-05T07:50:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:58 smithi175 ceph-mon[34585]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:50:59.118 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:50:59.546 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:50:59 smithi144 ceph-mon[29535]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.659+0000 7f870ec00640 1 -- 172.21.15.144:0/2378475351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708104f60 msgr2=0x7f87081053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.659+0000 7f870ec00640 1 --2- 172.21.15.144:0/2378475351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708104f60 0x7f87081053e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009900 tx=0x7f86f002a410 comp rx=0 tx=0).stop 2024-09-05T07:50:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 -- 172.21.15.144:0/2378475351 shutdown_connections 2024-09-05T07:50:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 --2- 172.21.15.144:0/2378475351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708105920 0x7f870810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 --2- 172.21.15.144:0/2378475351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708104f60 0x7f87081053e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 --2- 172.21.15.144:0/2378475351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708103e00 0x7f8708104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 -- 172.21.15.144:0/2378475351 >> 172.21.15.144:0/2378475351 conn(0x7f87080ff5b0 msgr2=0x7f87081019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 -- 172.21.15.144:0/2378475351 shutdown_connections 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.660+0000 7f870ec00640 1 -- 172.21.15.144:0/2378475351 wait complete. 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 Processor -- start 2024-09-05T07:50:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 -- start start 2024-09-05T07:50:59.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708103e00 0x7f870819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f870810fab0 con 0x7f8708105920 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f870810f930 con 0x7f8708103e00 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f870810fc30 con 0x7f8708104f60 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:37036/0 (socket says 172.21.15.144:37036) 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f870cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59396/0 (socket says 172.21.15.144:59396) 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f86ffe00640 1 -- 172.21.15.144:0/1794468671 learned_addr learned my addr 172.21.15.144:0/1794468671 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.661+0000 7f8707e00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708103e00 0x7f870819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 -- 172.21.15.144:0/1794468671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708103e00 msgr2=0x7f870819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:59.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708103e00 0x7f870819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 -- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 msgr2=0x7f87081a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 -- 172.21.15.144:0/1794468671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87081a1d20 con 0x7f8708104f60 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f870cc00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f86ffe00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86f0031610 tx=0x7f86f0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f003f030 con 0x7f8708104f60 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f0003ad0 con 0x7f8708104f60 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87081a1fb0 con 0x7f8708104f60 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.662+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0035070 con 0x7f8708104f60 2024-09-05T07:50:59.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.663+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87081a23a0 con 0x7f8708104f60 2024-09-05T07:50:59.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.664+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870810b260 con 0x7f8708104f60 2024-09-05T07:50:59.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.665+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f86f0042030 con 0x7f8708104f60 2024-09-05T07:50:59.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.667+0000 7f8705600640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 0x7f86ec0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:50:59.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.667+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f86f00ef960 con 0x7f8708104f60 2024-09-05T07:50:59.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.667+0000 7f8707e00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 0x7f86ec0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:50:59.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.667+0000 7f8707e00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 0x7f86ec0a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009bd0 tx=0x7f86f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:50:59.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.669+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86f00bc0a0 con 0x7f8708104f60 2024-09-05T07:50:59.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:50:59 smithi154 ceph-mon[34710]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:59.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:50:59 smithi175 ceph-mon[34585]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:50:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.854+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8708062630 con 0x7f86ec0a2c40 2024-09-05T07:50:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.855+0000 7f8705600640 1 -- 172.21.15.144:0/1794468671 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8708062630 con 0x7f86ec0a2c40 2024-09-05T07:50:59.856 INFO:teuthology.orchestra.run.smithi144.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-05T07:50:59.856 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-05T07:50:59.856 INFO:teuthology.orchestra.run.smithi144.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-05T07:50:59.856 INFO:teuthology.orchestra.run.smithi144.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-05T07:50:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 msgr2=0x7f86ec0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 0x7f86ec0a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009bd0 tx=0x7f86f8005f90 comp rx=0 tx=0).stop 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 msgr2=0x7f870819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86f0031610 tx=0x7f86f0004270 comp rx=0 tx=0).stop 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 shutdown_connections 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f86ec0a2c40 0x7f86ec0a5100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8708105920 0x7f87081a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8708104f60 0x7f870819a630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 --2- 172.21.15.144:0/1794468671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8708103e00 0x7f870819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:50:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 >> 172.21.15.144:0/1794468671 conn(0x7f87080ff5b0 msgr2=0x7f8708108430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:50:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 shutdown_connections 2024-09-05T07:50:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:50:59.858+0000 7f870ec00640 1 -- 172.21.15.144:0/1794468671 wait complete. 2024-09-05T07:51:00.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:00 smithi144 ceph-mon[29535]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:00 smithi154 ceph-mon[34710]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:00.749 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T07:51:00.759 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:51:00.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-05T07:51:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:00 smithi175 ceph-mon[34585]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:01.124 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:01.563 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:01 smithi144 ceph-mon[29535]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 -- 172.21.15.144:0/2538852816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc101a40 msgr2=0x7f24dc101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2538852816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc101a40 0x7f24dc101e40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009900 tx=0x7f24cc02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 -- 172.21.15.144:0/2538852816 shutdown_connections 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2538852816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2538852816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc103600 0x7f24dc109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2538852816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc101a40 0x7f24dc101e40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 -- 172.21.15.144:0/2538852816 >> 172.21.15.144:0/2538852816 conn(0x7f24dc0fd1f0 msgr2=0x7f24dc0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:01.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 -- 172.21.15.144:0/2538852816 shutdown_connections 2024-09-05T07:51:01.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.674+0000 7f24e0a00640 1 -- 172.21.15.144:0/2538852816 wait complete. 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.675+0000 7f24e0a00640 1 Processor -- start 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.675+0000 7f24e0a00640 1 -- start start 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc101a40 0x7f24dc197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 0x7f24dc19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d6d0 con 0x7f24dc103600 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d550 con 0x7f24dc102c40 2024-09-05T07:51:01.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24e0a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc10d850 con 0x7f24dc101a40 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 0x7f24dc19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:46242/0 (socket says 172.21.15.144:46242) 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24d3e00640 1 -- 172.21.15.144:0/2396563334 learned_addr learned my addr 172.21.15.144:0/2396563334 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24da800640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc101a40 0x7f24dc197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 -- 172.21.15.144:0/2396563334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc101a40 msgr2=0x7f24dc197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc101a40 0x7f24dc197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 -- 172.21.15.144:0/2396563334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 msgr2=0x7f24dc198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24db200640 1 -- 172.21.15.144:0/2396563334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc19f960 con 0x7f24dc103600 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.676+0000 7f24d3e00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:01.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24db200640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 0x7f24dc19f2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f24d400e940 tx=0x7f24d400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:01.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4004d20 con 0x7f24dc103600 2024-09-05T07:51:01.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24d4005020 con 0x7f24dc103600 2024-09-05T07:51:01.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc19fc50 con 0x7f24dc103600 2024-09-05T07:51:01.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40116b0 con 0x7f24dc103600 2024-09-05T07:51:01.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.677+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc1a0160 con 0x7f24dc103600 2024-09-05T07:51:01.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.678+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24dc108e40 con 0x7f24dc103600 2024-09-05T07:51:01.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.680+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f24d40054d0 con 0x7f24dc103600 2024-09-05T07:51:01.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.681+0000 7f24d3400640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 0x7f24c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:01.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.681+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f24d40cf5c0 con 0x7f24dc103600 2024-09-05T07:51:01.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.682+0000 7f24da800640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 0x7f24c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:01.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.683+0000 7f24da800640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 0x7f24c00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005ab0 tx=0x7f24cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:01.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.686+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24d4016030 con 0x7f24dc103600 2024-09-05T07:51:01.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:01 smithi154 ceph-mon[34710]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:01.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:01 smithi175 ceph-mon[34585]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:01.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.898+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f24dc02d7c0 con 0x7f24dc103600 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.898+0000 7f24d3400640 1 -- 172.21.15.144:0/2396563334 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3140 (secure 0 0 0) 0x7f24d409bd00 con 0x7f24dc103600 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout:e28 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout:btime 2024-09-05T07:49:29:357576+0000 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout:legacy client fscid: 1 2024-09-05T07:51:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:Filesystem 'cephfs' (1) 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:fs_name cephfs 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 28 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-09-05T07:49:15.848520+0000 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:modified 2024-09-05T07:49:29.252641+0000 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:tableserver 0 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:root 0 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:session_timeout 300 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:session_autoclose 300 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:max_file_size 1099511627776 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:max_xattr_size 65536 2024-09-05T07:51:01.900 INFO:teuthology.orchestra.run.smithi144.stdout:required_client_features {} 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:last_failure 0 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:last_failure_osd_epoch 0 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:max_mds 5 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:in 0,1,2,3,4 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:up {0=24533,1=24523,2=24521,3=24508,4=24502} 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:failed 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:damaged 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:stopped 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:data_pools [3] 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:metadata_pool 2 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:inline_data disabled 2024-09-05T07:51:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:balancer 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:bal_rank_mask -1 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:standby_count_wanted 0 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:qdb_cluster leader: 24533 members: 24502,24508,24521,24523,24533 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b{0:24533} state up:active seq 5 addr [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.h{0:24497} state up:standby-replay seq 1 addr [v2:172.21.15.154:6836/4186875626,v1:172.21.15.154:6837/4186875626] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.902 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.i{1:24523} state up:active seq 9 addr [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.903 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.e{1:24473} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/2155086348,v1:172.21.15.154:6835/2155086348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.903 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a{2:24521} state up:active seq 8 addr [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.903 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d{2:24461} state up:standby-replay seq 1 addr [v2:172.21.15.144:6836/2196844760,v1:172.21.15.144:6837/2196844760] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.903 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c{3:24508} state up:active seq 11 addr [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.l{3:24457} state up:standby-replay seq 1 addr [v2:172.21.15.175:6832/3404092101,v1:172.21.15.175:6833/3404092101] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.f{4:24502} state up:active seq 12 addr [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.k{4:24437} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/292119763,v1:172.21.15.154:6833/292119763] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:01.904 INFO:teuthology.orchestra.run.smithi144.stdout:Standby daemons: 2024-09-05T07:51:01.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:01.905 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.j{-1:14466} state up:standby seq 1 addr [v2:172.21.15.144:6834/3359383404,v1:172.21.15.144:6835/3359383404] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.905 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.g{-1:14517} state up:standby seq 1 addr [v2:172.21.15.144:6838/1312798702,v1:172.21.15.144:6839/1312798702] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T07:51:01.906 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:51:01.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.900+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 msgr2=0x7f24c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:01.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.900+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 0x7f24c00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005ab0 tx=0x7f24cc000bc0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.900+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 msgr2=0x7f24dc19f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.900+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 0x7f24dc19f2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f24d400e940 tx=0x7f24d400ee00 comp rx=0 tx=0).stop 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 shutdown_connections 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f24c00a2c10 0x7f24c00a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc102c40 0x7f24dc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24dc103600 0x7f24dc19f2c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 --2- 172.21.15.144:0/2396563334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24dc101a40 0x7f24dc197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:01.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 >> 172.21.15.144:0/2396563334 conn(0x7f24dc0fd1f0 msgr2=0x7f24dc106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:01.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 shutdown_connections 2024-09-05T07:51:01.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:01.901+0000 7f24e0a00640 1 -- 172.21.15.144:0/2396563334 wait complete. 2024-09-05T07:51:02.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:02 smithi144 ceph-mon[29535]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:51:02.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:02 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2396563334' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T07:51:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:02 smithi154 ceph-mon[34710]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:51:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:02 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2396563334' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T07:51:02.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-05T07:51:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:02 smithi175 ceph-mon[34585]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:51:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:02 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2396563334' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T07:51:03.121 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 -- 172.21.15.144:0/1258298802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 msgr2=0x7fa888104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 --2- 172.21.15.144:0/1258298802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa888104b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009900 tx=0x7fa87c02a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 -- 172.21.15.144:0/1258298802 shutdown_connections 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 --2- 172.21.15.144:0/1258298802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888105090 0x7fa888107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 --2- 172.21.15.144:0/1258298802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8881079c0 0x7fa888109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 --2- 172.21.15.144:0/1258298802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa888104b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 -- 172.21.15.144:0/1258298802 >> 172.21.15.144:0/1258298802 conn(0x7fa8880fc2a0 msgr2=0x7fa8880fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 -- 172.21.15.144:0/1258298802 shutdown_connections 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.776+0000 7fa88f800640 1 -- 172.21.15.144:0/1258298802 wait complete. 2024-09-05T07:51:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 Processor -- start 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 -- start start 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa88819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 0x7fa88819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 0x7fa8881a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa88810d8d0 con 0x7fa888102760 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa88810d750 con 0x7fa8881079c0 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.777+0000 7fa88f800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa88810da50 con 0x7fa888105090 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa88ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa88819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa88ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa88819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48752/0 (socket says 172.21.15.144:48752) 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa88ce00640 1 -- 172.21.15.144:0/2558992364 learned_addr learned my addr 172.21.15.144:0/2558992364 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 0x7fa88819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa88d800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 0x7fa8881a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 -- 172.21.15.144:0/2558992364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 msgr2=0x7fa8881a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 0x7fa8881a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 -- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 msgr2=0x7fa88819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa88819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa887e00640 1 -- 172.21.15.144:0/2558992364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8881a1d90 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.778+0000 7fa88d800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 0x7fa8881a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa887e00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 0x7fa88819a6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa87400d6a0 tx=0x7fa87400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874017070 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874009820 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8881a2080 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874004d00 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.779+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8881a25c0 con 0x7fa888105090 2024-09-05T07:51:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.780+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8881094b0 con 0x7fa888105090 2024-09-05T07:51:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.782+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa8740099d0 con 0x7fa888105090 2024-09-05T07:51:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.784+0000 7fa885600640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 0x7fa8700a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.784+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa8740ceb90 con 0x7fa888105090 2024-09-05T07:51:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.784+0000 7fa88ce00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 0x7fa8700a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.784+0000 7fa88ce00640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 0x7fa8700a5100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa87c031440 tx=0x7fa87c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.788+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa87409b920 con 0x7fa888105090 2024-09-05T07:51:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.962+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa88802da10 con 0x7fa888105090 2024-09-05T07:51:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.964+0000 7fa885600640 1 -- 172.21.15.144:0/2558992364 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5344 (secure 0 0 0) 0x7fa87409b220 con 0x7fa888105090 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 85 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-09-05T07:41:13.589749+0000 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:modified 2024-09-05T07:50:06.457858+0000 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:crush_version 26 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:full_ratio 0.95 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:backfillfull_ratio 0.9 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:nearfull_ratio 0.85 2024-09-05T07:51:03.965 INFO:teuthology.orchestra.run.smithi144.stdout:require_min_compat_client luminous 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:min_compat_client luminous 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:require_osd_release squid 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:stretch_mode_enabled false 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:max_osd 12 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6802/1617602534,v1:172.21.15.144:6803/1617602534] [v2:172.21.15.144:6804/1617602534,v1:172.21.15.144:6805/1617602534] exists,up 7c52fde6-9ed3-449b-8766-8d9e061d3cd8 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/3510298386,v1:172.21.15.154:6801/3510298386] [v2:172.21.15.154:6802/3510298386,v1:172.21.15.154:6803/3510298386] exists,up 8b29546a-9c89-436e-8088-5a87b65a9b3c 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/1799064874,v1:172.21.15.175:6801/1799064874] [v2:172.21.15.175:6802/1799064874,v1:172.21.15.175:6803/1799064874] exists,up 5835e07e-341b-4071-acc0-6d1de7f931a1 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6810/827690794,v1:172.21.15.144:6811/827690794] [v2:172.21.15.144:6812/827690794,v1:172.21.15.144:6813/827690794] exists,up 5dc8b828-3d7f-4248-b39e-5c5edc7650e0 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.4 up in weight 1 up_from 32 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/4185525506,v1:172.21.15.154:6809/4185525506] [v2:172.21.15.154:6810/4185525506,v1:172.21.15.154:6811/4185525506] exists,up b5e2a66d-cac2-4cd1-8559-df0856070bf0 2024-09-05T07:51:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:osd.5 up in weight 1 up_from 37 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/3675433893,v1:172.21.15.175:6809/3675433893] [v2:172.21.15.175:6810/3675433893,v1:172.21.15.175:6811/3675433893] exists,up aeee00a8-ae82-475e-8fc3-c027522f80a3 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.6 up in weight 1 up_from 45 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6818/2321298943,v1:172.21.15.144:6819/2321298943] [v2:172.21.15.144:6820/2321298943,v1:172.21.15.144:6821/2321298943] exists,up f7d7f17d-6323-408a-b7bb-7959f4778f91 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.7 up in weight 1 up_from 50 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1490453395,v1:172.21.15.154:6817/1490453395] [v2:172.21.15.154:6818/1490453395,v1:172.21.15.154:6819/1490453395] exists,up 4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.8 up in weight 1 up_from 57 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/1421352670,v1:172.21.15.175:6817/1421352670] [v2:172.21.15.175:6818/1421352670,v1:172.21.15.175:6819/1421352670] exists,up cf5ed3c6-80ad-4e8f-a862-c844a1bc749f 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6826/2500230647,v1:172.21.15.144:6827/2500230647] [v2:172.21.15.144:6828/2500230647,v1:172.21.15.144:6829/2500230647] exists,up 0975ea21-df34-40c4-96a3-80758343a594 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.10 up in weight 1 up_from 70 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/1235754603,v1:172.21.15.154:6825/1235754603] [v2:172.21.15.154:6826/1235754603,v1:172.21.15.154:6827/1235754603] exists,up cbdcbe9a-a9f5-4ba6-a198-493d6b15d654 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:osd.11 up in weight 1 up_from 77 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/3823820862,v1:172.21.15.175:6825/3823820862] [v2:172.21.15.175:6826/3823820862,v1:172.21.15.175:6827/3823820862] exists,up 39af7621-a97a-4c97-8a70-be9bc9772b10 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 2.a [2,11,8,4] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 2.b [2,4] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 2.1d [8,11] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.0 [5,9] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.11 [5,9] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.1b [4,6] 2024-09-05T07:51:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.1d [4,8] 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.22 [3,9] 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:pg_upmap_items 3.23 [4,7] 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:6801/490246891 expires 2024-09-06T07:42:05.153736+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:6800/490246891 expires 2024-09-06T07:42:05.153736+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/2725124016 expires 2024-09-06T07:42:05.153736+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/618061674 expires 2024-09-06T07:42:05.153736+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/1854894584 expires 2024-09-06T07:41:38.279521+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/2641423854 expires 2024-09-06T07:41:38.279521+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/952521696 expires 2024-09-06T07:42:05.153736+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:0/855242424 expires 2024-09-06T07:41:38.279521+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:6801/3542536787 expires 2024-09-06T07:41:38.279521+0000 2024-09-05T07:51:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:blocklist 172.21.15.144:6800/3542536787 expires 2024-09-06T07:41:38.279521+0000 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 msgr2=0x7fa8700a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 0x7fa8700a5100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa87c031440 tx=0x7fa87c0315b0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 msgr2=0x7fa88819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 0x7fa88819a6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa87400d6a0 tx=0x7fa87400db60 comp rx=0 tx=0).stop 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 shutdown_connections 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa8700a2c40 0x7fa8700a5100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8881079c0 0x7fa8881a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa888105090 0x7fa88819a6a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 --2- 172.21.15.144:0/2558992364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa888102760 0x7fa88819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:03.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 >> 172.21.15.144:0/2558992364 conn(0x7fa8880fc2a0 msgr2=0x7fa888101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:03.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 shutdown_connections 2024-09-05T07:51:03.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:03.966+0000 7fa88f800640 1 -- 172.21.15.144:0/2558992364 wait complete. 2024-09-05T07:51:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:04 smithi154 ceph-mon[34710]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:04 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2558992364' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T07:51:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:04 smithi144 ceph-mon[29535]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:04.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:04 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2558992364' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T07:51:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:04 smithi175 ceph-mon[34585]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:04 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2558992364' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T07:51:04.884 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-05T07:51:04.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:51:05.303 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 -- 172.21.15.144:0/1732490991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 msgr2=0x7f7b70104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 --2- 172.21.15.144:0/1732490991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b70104210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009900 tx=0x7f7b6002a410 comp rx=0 tx=0).stop 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 -- 172.21.15.144:0/1732490991 shutdown_connections 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 --2- 172.21.15.144:0/1732490991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b70108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 --2- 172.21.15.144:0/1732490991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 0x7f7b70110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 --2- 172.21.15.144:0/1732490991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b70104210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:05.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 -- 172.21.15.144:0/1732490991 >> 172.21.15.144:0/1732490991 conn(0x7f7b700ff910 msgr2=0x7f7b70101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 -- 172.21.15.144:0/1732490991 shutdown_connections 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.841+0000 7f7b74a00640 1 -- 172.21.15.144:0/1732490991 wait complete. 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.842+0000 7f7b74a00640 1 Processor -- start 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.842+0000 7f7b74a00640 1 -- start start 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.842+0000 7f7b74a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.842+0000 7f7b74a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b7019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b74a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 0x7f7b7019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b74a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b70114010 con 0x7f7b70103e30 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b74a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b70113e90 con 0x7f7b701047e0 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b74a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b70114190 con 0x7f7b70108f60 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:05.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48760/0 (socket says 172.21.15.144:48760) 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 -- 172.21.15.144:0/2415989484 learned_addr learned my addr 172.21.15.144:0/2415989484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b67e00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b7019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6f200640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 0x7f7b7019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 -- 172.21.15.144:0/2415989484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 msgr2=0x7f7b7019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 0x7f7b7019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 -- 172.21.15.144:0/2415989484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 msgr2=0x7f7b7019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b7019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b6e800640 1 -- 172.21.15.144:0/2415989484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7019f400 con 0x7f7b70103e30 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.843+0000 7f7b67e00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b7019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b6e800640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b60004770 tx=0x7f7b60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6003f070 con 0x7f7b70103e30 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7019f690 con 0x7f7b70103e30 2024-09-05T07:51:05.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b60031ca0 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60035030 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.844+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b701a6fd0 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.845+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b70105310 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.847+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7b60042070 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.848+0000 7f7b67400640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 0x7f7b540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.848+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f7b600ef690 con 0x7f7b70103e30 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.848+0000 7f7b67e00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 0x7f7b540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.849+0000 7f7b67e00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 0x7f7b540a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b700ffd30 tx=0x7f7b58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:05.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:05.852+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b600bbff0 con 0x7f7b70103e30 2024-09-05T07:51:06.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.060+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b70104210 con 0x7f7b70103e30 2024-09-05T07:51:06.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.061+0000 7f7b67400640 1 -- 172.21.15.144:0/2415989484 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7f7b600c02f0 con 0x7f7b70103e30 2024-09-05T07:51:06.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:06.062 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:51:06.063 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:51:06.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.063+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 msgr2=0x7f7b540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:06.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.063+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 0x7f7b540a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b700ffd30 tx=0x7f7b58005f90 comp rx=0 tx=0).stop 2024-09-05T07:51:06.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 msgr2=0x7f7b7019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:06.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b60004770 tx=0x7f7b60003c10 comp rx=0 tx=0).stop 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 shutdown_connections 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f7b540a2b80 0x7f7b540a5040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b701047e0 0x7f7b7019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b70108f60 0x7f7b7019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 --2- 172.21.15.144:0/2415989484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b70103e30 0x7f7b7019a450 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 >> 172.21.15.144:0/2415989484 conn(0x7f7b700ff910 msgr2=0x7f7b70100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:06.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 shutdown_connections 2024-09-05T07:51:06.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:06.064+0000 7f7b74a00640 1 -- 172.21.15.144:0/2415989484 wait complete. 2024-09-05T07:51:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:06 smithi144 ceph-mon[29535]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:51:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:06 smithi144 ceph-mon[29535]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T07:51:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:06 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2415989484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:06.840 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:06 smithi175 ceph-mon[34585]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:51:06.841 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:06 smithi175 ceph-mon[34585]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T07:51:06.841 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:06 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2415989484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:06 smithi154 ceph-mon[34710]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:51:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:06 smithi154 ceph-mon[34710]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T07:51:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:06 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2415989484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:06.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:51:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.850+0000 7f017c000640 1 -- 172.21.15.144:0/954069729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074620 msgr2=0x7f0174074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.850+0000 7f017c000640 1 --2- 172.21.15.144:0/954069729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074620 0x7f0174074a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0168009900 tx=0x7f016802a480 comp rx=0 tx=0).stop 2024-09-05T07:51:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 -- 172.21.15.144:0/954069729 shutdown_connections 2024-09-05T07:51:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 --2- 172.21.15.144:0/954069729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f017410e3c0 0x7f0174110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 --2- 172.21.15.144:0/954069729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0174074f40 0x7f017410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 --2- 172.21.15.144:0/954069729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074620 0x7f0174074a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 -- 172.21.15.144:0/954069729 >> 172.21.15.144:0/954069729 conn(0x7f01740fd8c0 msgr2=0x7f01740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 -- 172.21.15.144:0/954069729 shutdown_connections 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.851+0000 7f017c000640 1 -- 172.21.15.144:0/954069729 wait complete. 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 Processor -- start 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 -- start start 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074f40 0x7f017419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017410e3c0 0x7f017419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0174114170 con 0x7f0174074f40 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0174113ff0 con 0x7f0174074620 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01741142f0 con 0x7f017410e3c0 2024-09-05T07:51:07.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f0179600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f0179600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:33944/0 (socket says 172.21.15.144:33944) 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f0179600640 1 -- 172.21.15.144:0/857057571 learned_addr learned my addr 172.21.15.144:0/857057571 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.852+0000 7f017a000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017410e3c0 0x7f017419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0178c00640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074f40 0x7f017419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 -- 172.21.15.144:0/857057571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017410e3c0 msgr2=0x7f017419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017410e3c0 0x7f017419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 -- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074f40 msgr2=0x7f017419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074f40 0x7f017419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 -- 172.21.15.144:0/857057571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017419f660 con 0x7f0174074620 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.853+0000 7f0179600640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f01680042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.854+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016803f030 con 0x7f0174074620 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.854+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0168003ce0 con 0x7f0174074620 2024-09-05T07:51:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.854+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168035070 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.854+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017419f8f0 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.854+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017419fd80 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.855+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0174074a00 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.857+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0168042030 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.858+0000 7f0172000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.858+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f01680ef8d0 con 0x7f0174074620 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.858+0000 7f0178c00640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.859+0000 7f0178c00640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 0x7f015c0a50c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f01740ffec0 tx=0x7f016000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:07.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:07.860+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01680bc230 con 0x7f0174074620 2024-09-05T07:51:08.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.071+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f017419ba10 con 0x7f0174074620 2024-09-05T07:51:08.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.072+0000 7f0172000640 1 -- 172.21.15.144:0/857057571 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11992 (secure 0 0 0) 0x7f017419ba10 con 0x7f0174074620 2024-09-05T07:51:08.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:08.073 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-05T07:49:29:357576+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:49:29.252641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24502,24508,24521,24523,24533]},"id":1}]} 2024-09-05T07:51:08.074 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-05T07:51:08.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.074+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 msgr2=0x7f015c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:08.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.074+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 0x7f015c0a50c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f01740ffec0 tx=0x7f016000b390 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.074+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 msgr2=0x7f017419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.074+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f01680042f0 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 shutdown_connections 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017410e3c0 0x7f017419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0174074f40 0x7f017419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 --2- 172.21.15.144:0/857057571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0174074620 0x7f017419a6b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 >> 172.21.15.144:0/857057571 conn(0x7f01740fd8c0 msgr2=0x7f01740ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 shutdown_connections 2024-09-05T07:51:08.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:08.075+0000 7f017c000640 1 -- 172.21.15.144:0/857057571 wait complete. 2024-09-05T07:51:08.763 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:08 smithi144 ceph-mon[29535]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:51:08.763 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:08 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/857057571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:08.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:51:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:08 smithi175 ceph-mon[34585]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:51:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:08 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/857057571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:08 smithi154 ceph-mon[34710]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-05T07:51:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:08 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/857057571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:51:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 -- 172.21.15.144:0/1642633132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8077040 msgr2=0x7f79c8112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 --2- 172.21.15.144:0/1642633132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8077040 0x7f79c8112330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009900 tx=0x7f79b402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 -- 172.21.15.144:0/1642633132 shutdown_connections 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 --2- 172.21.15.144:0/1642633132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8112870 0x7f79c8114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 --2- 172.21.15.144:0/1642633132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8077040 0x7f79c8112330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 --2- 172.21.15.144:0/1642633132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8076720 0x7f79c8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 -- 172.21.15.144:0/1642633132 >> 172.21.15.144:0/1642633132 conn(0x7f79c80ff8d0 msgr2=0x7f79c8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 -- 172.21.15.144:0/1642633132 shutdown_connections 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.715+0000 7f79ce400640 1 -- 172.21.15.144:0/1642633132 wait complete. 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.716+0000 7f79ce400640 1 Processor -- start 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.716+0000 7f79ce400640 1 -- start start 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8077040 0x7f79c81a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8112870 0x7f79c819e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8118430 con 0x7f79c8076720 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81182b0 con 0x7f79c8077040 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79ce400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81185b0 con 0x7f79c8112870 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48794/0 (socket says 172.21.15.144:48794) 2024-09-05T07:51:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 -- 172.21.15.144:0/279661127 learned_addr learned my addr 172.21.15.144:0/279661127 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:09.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79c7e00640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8077040 0x7f79c81a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:09.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cda00640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8112870 0x7f79c819e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 -- 172.21.15.144:0/279661127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8112870 msgr2=0x7f79c819e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8112870 0x7f79c819e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 -- 172.21.15.144:0/279661127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8077040 msgr2=0x7f79c81a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.717+0000 7f79cd000640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8077040 0x7f79c81a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79cd000640 1 -- 172.21.15.144:0/279661127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c819ef90 con 0x7f79c8076720 2024-09-05T07:51:09.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79cd000640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00e9f0 tx=0x7f79bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00cd80 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79bc010910 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c819f280 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc018990 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.718+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81ab5d0 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.719+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c819f610 con 0x7f79c8076720 2024-09-05T07:51:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.721+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f79bc010ac0 con 0x7f79c8076720 2024-09-05T07:51:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.722+0000 7f79c5600640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 0x7f79b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.722+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f79bc0cf320 con 0x7f79c8076720 2024-09-05T07:51:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.723+0000 7f79c7e00640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 0x7f79b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.723+0000 7f79c7e00640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 0x7f79b00a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79b4000c00 tx=0x7f79b4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:09.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.727+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79bc09bbc0 con 0x7f79c8076720 2024-09-05T07:51:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.904+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79c819fc50 con 0x7f79c8076720 2024-09-05T07:51:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.906+0000 7f79c5600640 1 -- 172.21.15.144:0/279661127 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22868 (secure 0 0 0) 0x7f79bc09fec0 con 0x7f79c8076720 2024-09-05T07:51:09.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:51:09.907 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":85,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:50:06.457858+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:51:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.908+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 msgr2=0x7f79b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 0x7f79b00a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79b4000c00 tx=0x7f79b4005b50 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 msgr2=0x7f79c81a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00e9f0 tx=0x7f79bc00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 shutdown_connections 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79b00a2c00 0x7f79b00a50c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79c8077040 0x7f79c81a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c8112870 0x7f79c819e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 --2- 172.21.15.144:0/279661127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79c8076720 0x7f79c81a4650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 >> 172.21.15.144:0/279661127 conn(0x7f79c80ff8d0 msgr2=0x7f79c8101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 shutdown_connections 2024-09-05T07:51:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:09.909+0000 7f79ce400640 1 -- 172.21.15.144:0/279661127 wait complete. 2024-09-05T07:51:10.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:10 smithi144 ceph-mon[29535]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:51:10.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:10 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/279661127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:51:10.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T07:49:15.848520+0000', 'modified': '2024-09-05T07:49:29.252641+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24533, 'mds_1': 24523, 'mds_2': 24521, 'mds_3': 24508, 'mds_4': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/292119763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 292119763}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 292119763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3404092101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3404092101}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3404092101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'd', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/2196844760', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 2196844760}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2196844760}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/2155086348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2155086348}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2155086348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/4186875626', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 4186875626}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 4186875626}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.175:6835/1249902842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1249902842}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1249902842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.175:6837/470737720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 470737720}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 470737720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'a', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6841/1329376648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6840', 'nonce': 1329376648}, {'type': 'v1', 'addr': '172.21.15.144:6841', 'nonce': 1329376648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.175:6839/571012615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 571012615}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 571012615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/3557171279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3557171279}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3557171279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24533, 'qdb_cluster': [24502, 24508, 24521, 24523, 24533]} 2024-09-05T07:51:10.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-05T07:51:10.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.f status 2024-09-05T07:51:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:10 smithi175 ceph-mon[34585]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:51:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:10 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/279661127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:51:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:10 smithi154 ceph-mon[34710]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-05T07:51:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:10 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/279661127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:51:11.021 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 -- 172.21.15.144:0/398881723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff128103e30 msgr2=0x7ff128104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 --2- 172.21.15.144:0/398881723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff128103e30 0x7ff128104210 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff118009900 tx=0x7ff11802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 -- 172.21.15.144:0/398881723 shutdown_connections 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 --2- 172.21.15.144:0/398881723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff128110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 --2- 172.21.15.144:0/398881723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1281047e0 0x7ff128108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 --2- 172.21.15.144:0/398881723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff128103e30 0x7ff128104210 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 -- 172.21.15.144:0/398881723 >> 172.21.15.144:0/398881723 conn(0x7ff1280ff8d0 msgr2=0x7ff128101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 -- 172.21.15.144:0/398881723 shutdown_connections 2024-09-05T07:51:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.561+0000 7ff12da00640 1 -- 172.21.15.144:0/398881723 wait complete. 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 Processor -- start 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 -- start start 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 0x7ff12819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff12819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.562+0000 7ff12da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff128113fc0 con 0x7ff1281047e0 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff12da00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff128113e40 con 0x7ff128108f60 2024-09-05T07:51:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff12da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff128114140 con 0x7ff128103e30 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48810/0 (socket says 172.21.15.144:48810) 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 -- 172.21.15.144:0/3201995107 learned_addr learned my addr 172.21.15.144:0/3201995107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff127e00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 0x7ff12819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff12d000640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff12819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 -- 172.21.15.144:0/3201995107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 msgr2=0x7ff12819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 0x7ff12819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 -- 172.21.15.144:0/3201995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 msgr2=0x7ff12819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff12819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff11fe00640 1 -- 172.21.15.144:0/3201995107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12819f430 con 0x7ff1281047e0 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff12d000640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff12819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.563+0000 7ff127e00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 0x7ff12819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff11000e9f0 tx=0x7ff11000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff125600640 1 -- 172.21.15.144:0/3201995107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11000cd80 con 0x7ff1281047e0 2024-09-05T07:51:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff125600640 1 -- 172.21.15.144:0/3201995107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff110005500 con 0x7ff1281047e0 2024-09-05T07:51:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff125600640 1 -- 172.21.15.144:0/3201995107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110010690 con 0x7ff1281047e0 2024-09-05T07:51:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12819f720 con 0x7ff1281047e0 2024-09-05T07:51:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.564+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a7000 con 0x7ff1281047e0 2024-09-05T07:51:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.568+0000 7ff131c6a740 1 Processor -- start 2024-09-05T07:51:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.568+0000 7ff131c6a740 1 -- start start 2024-09-05T07:51:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.568+0000 7ff125600640 1 -- 172.21.15.144:0/3201995107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff1100046c0 con 0x7ff1281047e0 2024-09-05T07:51:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.568+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 0x55c0276ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276d56c0 0x55c0276d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff131c6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c0276300b0 con 0x55c0276d56c0 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff131c6a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c0275d7ab0 con 0x55c0276ca4e0 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff131c6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c02762c070 con 0x55c0276cae00 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276d56c0 0x55c0276d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff12d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 0x55c0276ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff12d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 0x55c0276ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:34006/0 (socket says 172.21.15.144:34006) 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff12d000640 1 -- 172.21.15.144:0/1759306297 learned_addr learned my addr 172.21.15.144:0/1759306297 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 -- 172.21.15.144:0/1759306297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 msgr2=0x55c0276ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 0x55c0276ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 -- 172.21.15.144:0/1759306297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276d56c0 msgr2=0x55c0276d7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276d56c0 0x55c0276d7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.569+0000 7ff127e00640 1 -- 172.21.15.144:0/1759306297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0275e44a0 con 0x55c0276cae00 2024-09-05T07:51:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff127e00640 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d5180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff118005940 tx=0x7ff118005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8fe0f807b620797 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff125600640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 0x7ff10c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff11d600640 1 -- 172.21.15.144:0/1759306297 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118035040 con 0x55c0276cae00 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff11d600640 1 -- 172.21.15.144:0/1759306297 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff118031830 con 0x55c0276cae00 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff11d600640 1 -- 172.21.15.144:0/1759306297 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118004750 con 0x55c0276cae00 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff125600640 1 -- 172.21.15.144:0/3201995107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff1100cf480 con 0x7ff1281047e0 2024-09-05T07:51:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.570+0000 7ff12d000640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 0x7ff10c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 -- 172.21.15.144:0/1759306297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 msgr2=0x55c0276d5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d5180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff118005940 tx=0x7ff118005d50 comp rx=0 tx=0).stop 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff12d000640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 0x7ff10c0a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff120009fd0 tx=0x7ff120009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 -- 172.21.15.144:0/1759306297 shutdown_connections 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276d56c0 0x55c0276d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d5180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 --2- 172.21.15.144:0/1759306297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276ca4e0 0x55c0276ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 -- 172.21.15.144:0/1759306297 >> 172.21.15.144:0/1759306297 conn(0x55c0276c6a70 msgr2=0x55c0276c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 -- 172.21.15.144:0/1759306297 shutdown_connections 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.571+0000 7ff131c6a740 1 -- 172.21.15.144:0/1759306297 wait complete. 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 -- start start 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 Processor -- start 2024-09-05T07:51:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c0276d8330 con 0x55c0276ca4e0 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c0275b8920 con 0x55c0276d56c0 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c0276d84b0 con 0x55c0276cae00 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.572+0000 7ff131c6a740 10 client.0 _ll_register_callbacks cb 0x55c0275dc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff12d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff12d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:34012/0 (socket says 172.21.15.144:34012) 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:40700/0 (socket says 172.21.15.144:40700) 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff12d000640 1 -- 172.21.15.144:0/3974571081 learned_addr learned my addr 172.21.15.144:0/3974571081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:11.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 -- 172.21.15.144:0/3974571081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 msgr2=0x55c0276d2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276d2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 -- 172.21.15.144:0/3974571081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 msgr2=0x55c0276d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff127e00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 -- 172.21.15.144:0/3974571081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0273a12b0 con 0x55c0276cae00 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff127e00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff11fe00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1100ccfc0 tx=0x7ff110009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968fd8db218f2649 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.573+0000 7ff116000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11009b810 con 0x55c0276cae00 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff118031830 con 0x55c0276cae00 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff1100a44b0 con 0x55c0276cae00 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff11009b630 con 0x55c0276cae00 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff131c6a740 10 client.25036 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:11.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0276e4040 con 0x55c0276cae00 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff118031830 con 0x55c0276cae00 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff11009b120 con 0x55c0276cae00 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.574+0000 7ff131c6a740 10 client.25036 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff131c6a740 10 client.25036 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff131c6a740 20 client.25036 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c0276e65f0 0x55c0276e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff131c6a740 4 client.25036 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 --> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c02763d620 con 0x55c0276e65f0 2024-09-05T07:51:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff127e00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c0276e65f0 0x55c0276e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff127e00640 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c0276e65f0 0x55c0276e7a60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5547adfb54c15b46 server_cookie=df645cf86e997ef7 in_seq=0 out_seq=0 2024-09-05T07:51:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.575+0000 7ff116000640 10 client.25036 ms_handle_connect on v2:172.21.15.175:6834/1249902842 2024-09-05T07:51:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.576+0000 7ff116000640 1 -- 172.21.15.144:0/3974571081 <== mds.4 v2:172.21.15.175:6834/1249902842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c02763d620 con 0x55c0276e65f0 2024-09-05T07:51:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.576+0000 7ff116000640 10 client.25036 handle_command_reply: tid=0 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.576+0000 7ff131c6a740 1 client.25036 shutdown 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 msgr2=0x55c0276d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1100ccfc0 tx=0x7ff110009310 comp rx=0 tx=0).stop 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 shutdown_connections 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c0276e65f0 0x55c0276e7a60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276d2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276cae00 0x55c0276d2aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff116000640 0 client.25036 ms_handle_reset on v2:172.21.15.175:6834/1249902842 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 --2- 172.21.15.144:0/3974571081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 >> 172.21.15.144:0/3974571081 conn(0x55c0276c6a70 msgr2=0x55c0276cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 shutdown_connections 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 1 -- 172.21.15.144:0/3974571081 wait complete. 2024-09-05T07:51:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.577+0000 7ff131c6a740 20 client.25036 trim_cache size 0 max 16384 2024-09-05T07:51:11.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 Processor -- start 2024-09-05T07:51:11.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 -- start start 2024-09-05T07:51:11.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 0x55c0276ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276d56c0 0x55c0276d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e5da0 con 0x55c0276ca4e0 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e6470 con 0x55c0276cae00 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.595+0000 7ff131c6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e6b40 con 0x55c0276d56c0 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48826/0 (socket says 172.21.15.144:48826) 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 -- 172.21.15.144:0/2102924523 learned_addr learned my addr 172.21.15.144:0/2102924523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff11fe00640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 0x55c0276ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff12d000640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276d56c0 0x55c0276d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 -- 172.21.15.144:0/2102924523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276d56c0 msgr2=0x55c0276d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276d56c0 0x55c0276d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 -- 172.21.15.144:0/2102924523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 msgr2=0x55c0276ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 0x55c0276ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 -- 172.21.15.144:0/2102924523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0276e22b0 con 0x55c0276ca4e0 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff11fe00640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 0x55c0276ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.596+0000 7ff127e00640 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff11802a910 tx=0x7ff11802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac70c3678cbc526 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff11cc00640 1 -- 172.21.15.144:0/2102924523 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118035040 con 0x55c0276ca4e0 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff11cc00640 1 -- 172.21.15.144:0/2102924523 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1180318b0 con 0x55c0276ca4e0 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff11cc00640 1 -- 172.21.15.144:0/2102924523 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118003db0 con 0x55c0276ca4e0 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 -- 172.21.15.144:0/2102924523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 msgr2=0x55c0276e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff11802a910 tx=0x7ff11802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 -- 172.21.15.144:0/2102924523 shutdown_connections 2024-09-05T07:51:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276cae00 0x55c0276ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276d56c0 0x55c0276d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2102924523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276ca4e0 0x55c0276e7a60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.597+0000 7ff131c6a740 1 -- 172.21.15.144:0/2102924523 >> 172.21.15.144:0/2102924523 conn(0x55c0276c6a70 msgr2=0x55c0276cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.598+0000 7ff131c6a740 1 -- 172.21.15.144:0/2102924523 shutdown_connections 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.598+0000 7ff131c6a740 1 -- 172.21.15.144:0/2102924523 wait complete. 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.598+0000 7ff131c6a740 1 -- start start 2024-09-05T07:51:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.598+0000 7ff131c6a740 1 Processor -- start 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276ca4e0 0x55c0276e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276ea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e78e0 con 0x55c0276cae00 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e7210 con 0x55c0276d56c0 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c0276e7fb0 con 0x55c0276ca4e0 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff131c6a740 10 client.0 _ll_register_callbacks cb 0x7ff110009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48828/0 (socket says 172.21.15.144:48828) 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 -- 172.21.15.144:0/2667262567 learned_addr learned my addr 172.21.15.144:0/2667262567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:11.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff127e00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276ca4e0 0x55c0276e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff12d000640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 -- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276ca4e0 msgr2=0x55c0276e9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276ca4e0 0x55c0276e9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 -- 172.21.15.144:0/2667262567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 msgr2=0x55c0276ea490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276ea490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.599+0000 7ff11fe00640 1 -- 172.21.15.144:0/2667262567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0276ee200 con 0x55c0276cae00 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff11fe00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c6a0 tx=0x7ff11000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c189855250fcd6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11009b810 con 0x55c0276cae00 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff11009aed0 con 0x55c0276cae00 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1180318b0 con 0x55c0276cae00 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff1100cf2e0 con 0x55c0276cae00 2024-09-05T07:51:11.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 10 client.15036 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c027750fb0 con 0x55c0276cae00 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1180318b0 con 0x55c0276cae00 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff1100a4c20 con 0x55c0276cae00 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 10 client.15036 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 10 client.15036 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.600+0000 7ff131c6a740 20 client.15036 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c027755960 0x55c027754670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff131c6a740 4 client.15036 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 --> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] -- command(tid 0: {"prefix": "status"}) -- 0x55c027637b30 con 0x55c027755960 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff127e00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c027755960 0x55c027754670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff127e00640 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c027755960 0x55c027754670 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ba9ea841220063e server_cookie=c8fa054c08feca9c in_seq=0 out_seq=0 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.601+0000 7ff116000640 10 client.15036 ms_handle_connect on v2:172.21.15.175:6834/1249902842 2024-09-05T07:51:11.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff116000640 1 -- 172.21.15.144:0/2667262567 <== mds.4 v2:172.21.15.175:6834/1249902842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c027637b30 con 0x55c027755960 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff116000640 10 client.15036 handle_command_reply: tid=0 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 client.15036 shutdown 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 msgr2=0x55c0276e9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c6a0 tx=0x7ff11000cf90 comp rx=0 tx=0).stop 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 shutdown_connections 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:6834/1249902842,v1:172.21.15.175:6835/1249902842] conn(0x55c027755960 0x55c027754670 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0276d56c0 0x55c0276ea490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0276cae00 0x55c0276e9f50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff116000640 0 client.15036 ms_handle_reset on v2:172.21.15.175:6834/1249902842 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 --2- 172.21.15.144:0/2667262567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0276ca4e0 0x55c0276e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 >> 172.21.15.144:0/2667262567 conn(0x55c0276c6a70 msgr2=0x55c0276d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 shutdown_connections 2024-09-05T07:51:11.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 1 -- 172.21.15.144:0/2667262567 wait complete. 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.602+0000 7ff131c6a740 20 client.15036 trim_cache size 0 max 16384 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 4, 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24502, 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:51:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 104.256915036, 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 146.37146484799999 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:51:11.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 msgr2=0x7ff10c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 0x7ff10c0a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff120009fd0 tx=0x7ff120009500 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 msgr2=0x7ff12819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff11000e9f0 tx=0x7ff11000edf0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 shutdown_connections 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff10c0a2c00 0x7ff10c0a50c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff128108f60 0x7ff12819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1281047e0 0x7ff12819a9c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 --2- 172.21.15.144:0/3201995107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff128103e30 0x7ff12819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 >> 172.21.15.144:0/3201995107 conn(0x7ff1280ff8d0 msgr2=0x7ff128100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 shutdown_connections 2024-09-05T07:51:11.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:11.603+0000 7ff12da00640 1 -- 172.21.15.144:0/3201995107 wait complete. 2024-09-05T07:51:12.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.c status 2024-09-05T07:51:12.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:12 smithi144 ceph-mon[29535]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T07:51:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:12 smithi175 ceph-mon[34585]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T07:51:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:12 smithi154 ceph-mon[34710]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-05T07:51:13.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 -- 172.21.15.144:0/3542368811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4101de0 msgr2=0x7f89b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 --2- 172.21.15.144:0/3542368811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4101de0 0x7f89b41021c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a402a410 comp rx=0 tx=0).stop 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 -- 172.21.15.144:0/3542368811 shutdown_connections 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 --2- 172.21.15.144:0/3542368811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4102790 0x7f89b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 --2- 172.21.15.144:0/3542368811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 --2- 172.21.15.144:0/3542368811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4101de0 0x7f89b41021c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.244+0000 7f89bb200640 1 -- 172.21.15.144:0/3542368811 >> 172.21.15.144:0/3542368811 conn(0x7f89b40fd8c0 msgr2=0x7f89b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.245+0000 7f89bb200640 1 -- 172.21.15.144:0/3542368811 shutdown_connections 2024-09-05T07:51:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.245+0000 7f89bb200640 1 -- 172.21.15.144:0/3542368811 wait complete. 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 Processor -- start 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 -- start start 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 0x7f89b419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4111fc0 con 0x7f89b4102790 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4111e40 con 0x7f89b4101de0 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89bb200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4112140 con 0x7f89b4106f10 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34058/0 (socket says 172.21.15.144:34058) 2024-09-05T07:51:13.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89ab400640 1 -- 172.21.15.144:0/1555742781 learned_addr learned my addr 172.21.15.144:0/1555742781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.246+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 0x7f89b419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b9200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 -- 172.21.15.144:0/1555742781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 msgr2=0x7f89b419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 -- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 msgr2=0x7f89b419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 -- 172.21.15.144:0/1555742781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b419f5f0 con 0x7f89b4101de0 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b9200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:13.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89ab400640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:13.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 0x7f89b419a640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89a402a930 tx=0x7f89a4003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.247+0000 7f89b1600640 1 -- 172.21.15.144:0/1555742781 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a403f070 con 0x7f89b4101de0 2024-09-05T07:51:13.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.248+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b419f880 con 0x7f89b4101de0 2024-09-05T07:51:13.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.248+0000 7f89b1600640 1 -- 172.21.15.144:0/1555742781 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a4031c90 con 0x7f89b4101de0 2024-09-05T07:51:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.248+0000 7f89b1600640 1 -- 172.21.15.144:0/1555742781 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4035030 con 0x7f89b4101de0 2024-09-05T07:51:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.248+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b41a71c0 con 0x7f89b4101de0 2024-09-05T07:51:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.250+0000 7f89bdbe5740 1 Processor -- start 2024-09-05T07:51:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89b1600640 1 -- 172.21.15.144:0/1555742781 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f89a4042070 con 0x7f89b4101de0 2024-09-05T07:51:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 -- start start 2024-09-05T07:51:13.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0ab3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593b0a190b0 con 0x5593b0abe510 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593b09c0ab0 con 0x5593b0ab3330 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b0a15070 con 0x5593b0ab3c50 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34072/0 (socket says 172.21.15.144:34072) 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89ab400640 1 -- 172.21.15.144:0/74679599 learned_addr learned my addr 172.21.15.144:0/74679599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:13.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.251+0000 7f89b9200640 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0ab3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 -- 172.21.15.144:0/74679599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 msgr2=0x5593b0abdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 -- 172.21.15.144:0/74679599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 msgr2=0x5593b0ac0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 -- 172.21.15.144:0/74679599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b09cd4a0 con 0x5593b0ab3330 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89ab400640 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b9200640 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0ab3710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009f10 tx=0x7f89ac0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79cbb71f7399d2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89b1600640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.252+0000 7f89a9600640 1 -- 172.21.15.144:0/74679599 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac01c680 con 0x5593b0ab3330 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89a9600640 1 -- 172.21.15.144:0/74679599 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ac01cd00 con 0x5593b0ab3330 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89a9600640 1 -- 172.21.15.144:0/74679599 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac01a380 con 0x5593b0ab3330 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89b1600640 1 -- 172.21.15.144:0/1555742781 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f89a40efa30 con 0x7f89b4101de0 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 -- 172.21.15.144:0/74679599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 msgr2=0x5593b0ab3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0ab3710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009f10 tx=0x7f89ac0107a0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89b3e00640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 0x7f89980a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f89a40ed890 tx=0x7f89a40f3510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 -- 172.21.15.144:0/74679599 shutdown_connections 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0ac0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/74679599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0ab3710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 -- 172.21.15.144:0/74679599 >> 172.21.15.144:0/74679599 conn(0x5593b0aaf8c0 msgr2=0x5593b0aafca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.253+0000 7f89bdbe5740 1 -- 172.21.15.144:0/74679599 shutdown_connections 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.254+0000 7f89bdbe5740 1 -- 172.21.15.144:0/74679599 wait complete. 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.254+0000 7f89bdbe5740 1 -- start start 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.254+0000 7f89bdbe5740 1 Processor -- start 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0abb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0abc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593b0ac1060 con 0x5593b0abe510 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593b09a1920 con 0x5593b0ab3330 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b0ac11e0 con 0x5593b0ab3c50 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89bdbe5740 10 client.0 _ll_register_callbacks cb 0x5593b09c58a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:43386/0 (socket says 172.21.15.144:43386) 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 -- 172.21.15.144:0/4048686079 learned_addr learned my addr 172.21.15.144:0/4048686079 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89b9200640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0abc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89b9200640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0abb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 -- 172.21.15.144:0/4048686079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 msgr2=0x5593b0abb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0abb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 -- 172.21.15.144:0/4048686079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 msgr2=0x5593b0abc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0abc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89ab400640 1 -- 172.21.15.144:0/4048686079 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b078a2b0 con 0x5593b0ab3c50 2024-09-05T07:51:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.255+0000 7f89b9200640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0abb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89ab400640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f899c012d20 tx=0x7f899c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d48e9496687f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89a2000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:51:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c00fe20 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89ac01cd00 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f899c010430 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f899c010630 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89bdbe5740 10 client.25054 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.256+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593b0accf20 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ac01cd00 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f899c025050 con 0x5593b0ab3c50 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 10 client.25054 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 10 client.25054 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 20 client.25054 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0acf500 0x5593b0ad0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 4 client.25054 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 --> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593b0a26620 con 0x5593b0acf500 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.257+0000 7f89b9200640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0acf500 0x5593b0ad0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.258+0000 7f89b9200640 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0acf500 0x5593b0ad0970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7e911c55d773fcee server_cookie=ca587859432bb4c5 in_seq=0 out_seq=0 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.258+0000 7f89a2000640 10 client.25054 ms_handle_connect on v2:172.21.15.175:6836/470737720 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89a2000640 1 -- 172.21.15.144:0/4048686079 <== mds.3 v2:172.21.15.175:6836/470737720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593b0a26620 con 0x5593b0acf500 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89a2000640 10 client.25054 handle_command_reply: tid=0 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 client.25054 shutdown 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 msgr2=0x5593b0abbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f899c012d20 tx=0x7f899c00f790 comp rx=0 tx=0).stop 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 shutdown_connections 2024-09-05T07:51:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0acf500 0x5593b0ad0970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0abe510 0x5593b0abc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3c50 0x5593b0abbbb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/4048686079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3330 0x5593b0abb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 >> 172.21.15.144:0/4048686079 conn(0x5593b0aaf8c0 msgr2=0x5593b0ab55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89a2000640 0 client.25054 ms_handle_reset on v2:172.21.15.175:6836/470737720 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 shutdown_connections 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 1 -- 172.21.15.144:0/4048686079 wait complete. 2024-09-05T07:51:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.259+0000 7f89bdbe5740 20 client.25054 trim_cache size 0 max 16384 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 Processor -- start 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 -- start start 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 0x5593b0aba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0abe510 0x5593b0ab8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593b0acecb0 con 0x5593b0ab3330 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593b0acf380 con 0x5593b0ab3c50 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b0acfa50 con 0x5593b0abe510 2024-09-05T07:51:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34090/0 (socket says 172.21.15.144:34090) 2024-09-05T07:51:13.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89b9200640 1 -- 172.21.15.144:0/358456822 learned_addr learned my addr 172.21.15.144:0/358456822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:13.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89ab400640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 0x5593b0aba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.278+0000 7f89b9200640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0abe510 0x5593b0ab8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 -- 172.21.15.144:0/358456822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0abe510 msgr2=0x5593b0ab8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0abe510 0x5593b0ab8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 -- 172.21.15.144:0/358456822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 msgr2=0x5593b0ad02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 -- 172.21.15.144:0/358456822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b0abdfe0 con 0x5593b0ab3c50 2024-09-05T07:51:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89b9200640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89ab400640 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 0x5593b0aba690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f899c012cf0 tx=0x7f899c0122e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788a7c66b5b26eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89a8c00640 1 -- 172.21.15.144:0/358456822 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c01cb50 con 0x5593b0ab3c50 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89a8c00640 1 -- 172.21.15.144:0/358456822 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f899c02b020 con 0x5593b0ab3c50 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.279+0000 7f89a8c00640 1 -- 172.21.15.144:0/358456822 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c01c640 con 0x5593b0ab3c50 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- 172.21.15.144:0/358456822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 msgr2=0x5593b0aba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 0x5593b0aba690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f899c012cf0 tx=0x7f899c0122e0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- 172.21.15.144:0/358456822 shutdown_connections 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0ab3c50 0x5593b0aba690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0abe510 0x5593b0ab8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/358456822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3330 0x5593b0ad02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- 172.21.15.144:0/358456822 >> 172.21.15.144:0/358456822 conn(0x5593b0aaf8c0 msgr2=0x5593b0ab9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- 172.21.15.144:0/358456822 shutdown_connections 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- 172.21.15.144:0/358456822 wait complete. 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.280+0000 7f89bdbe5740 1 -- start start 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 Processor -- start 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 0x5593b0ad8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0abe510 0x5593b0ad3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593b0ad07f0 con 0x5593b0ab3c50 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593b0ad0120 con 0x5593b0abe510 2024-09-05T07:51:13.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b0ad0ec0 con 0x5593b0ab3330 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89bdbe5740 10 client.0 _ll_register_callbacks cb 0x7f899c0127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89b9200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0abe510 0x5593b0ad3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34104/0 (socket says 172.21.15.144:34104) 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89ab400640 1 -- 172.21.15.144:0/1460009238 learned_addr learned my addr 172.21.15.144:0/1460009238 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:13.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.281+0000 7f89b9200640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 0x5593b0ad8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 -- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 msgr2=0x5593b0ad8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 0x5593b0ad8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 -- 172.21.15.144:0/1460009238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0abe510 msgr2=0x5593b0ad3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0abe510 0x5593b0ad3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 -- 172.21.15.144:0/1460009238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b0ad40c0 con 0x5593b0ab3c50 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89b9200640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 0x5593b0ad8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89ab400640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f899c01cad0 tx=0x7f899c01ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2900c928412a4aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89a2000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c034060 con 0x5593b0ab3c50 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f899c018040 con 0x5593b0ab3c50 2024-09-05T07:51:13.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.282+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f899c02b020 con 0x5593b0ab3c50 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f899c0052e0 con 0x5593b0ab3c50 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 10 client.15054 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593b0b42b30 con 0x5593b0ab3c50 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f899c02b020 con 0x5593b0ab3c50 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f899c025040 con 0x5593b0ab3c50 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 10 client.15054 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 10 client.15054 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 20 client.15054 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0b47500 0x5593b0b46210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 4 client.15054 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.283+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 --> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] -- command(tid 0: {"prefix": "status"}) -- 0x5593b0a20b30 con 0x5593b0b47500 2024-09-05T07:51:13.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89b9200640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0b47500 0x5593b0b46210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:13.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89b9200640 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0b47500 0x5593b0b46210 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b10e85db9cc050f server_cookie=99f3e5aacf094de4 in_seq=0 out_seq=0 2024-09-05T07:51:13.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89a2000640 10 client.15054 ms_handle_connect on v2:172.21.15.175:6836/470737720 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89a2000640 1 -- 172.21.15.144:0/1460009238 <== mds.3 v2:172.21.15.175:6836/470737720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5593b0a20b30 con 0x5593b0b47500 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89a2000640 10 client.15054 handle_command_reply: tid=0 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89bdbe5740 1 client.15054 shutdown 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 msgr2=0x5593b0ad9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.284+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f899c01cad0 tx=0x7f899c01ddc0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 shutdown_connections 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593b0abe510 0x5593b0ad3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:6836/470737720,v1:172.21.15.175:6837/470737720] conn(0x5593b0b47500 0x5593b0b46210 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593b0ab3c50 0x5593b0ad9110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 --2- 172.21.15.144:0/1460009238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b0ab3330 0x5593b0ad8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89a2000640 0 client.15054 ms_handle_reset on v2:172.21.15.175:6836/470737720 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 >> 172.21.15.144:0/1460009238 conn(0x5593b0aaf8c0 msgr2=0x5593b0aba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 shutdown_connections 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 1 -- 172.21.15.144:0/1460009238 wait complete. 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bdbe5740 20 client.15054 trim_cache size 0 max 16384 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:51:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 3, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24508, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 106.95019387400001, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 145.48177240999999 2024-09-05T07:51:13.293 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 msgr2=0x7f89980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 0x7f89980a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f89a40ed890 tx=0x7f89a40f3510 comp rx=0 tx=0).stop 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 msgr2=0x7f89b419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.285+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 0x7f89b419a640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89a402a930 tx=0x7f89a4003b20 comp rx=0 tx=0).stop 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 shutdown_connections 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b4106f10 0x7f89b419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89b4102790 0x7f89b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 --2- 172.21.15.144:0/1555742781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4101de0 0x7f89b419a640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 >> 172.21.15.144:0/1555742781 conn(0x7f89b40fd8c0 msgr2=0x7f89b40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 shutdown_connections 2024-09-05T07:51:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:13.286+0000 7f89bb200640 1 -- 172.21.15.144:0/1555742781 wait complete. 2024-09-05T07:51:14.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.a status 2024-09-05T07:51:14.428 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:14.725 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:14 smithi144 ceph-mon[29535]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-05T07:51:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:14 smithi175 ceph-mon[34585]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-05T07:51:14.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:14 smithi154 ceph-mon[34710]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 -- 172.21.15.144:0/3151444612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6340102d30 msgr2=0x7f6340103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 --2- 172.21.15.144:0/3151444612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6340102d30 0x7f6340103110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6330009900 tx=0x7f633002a480 comp rx=0 tx=0).stop 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 -- 172.21.15.144:0/3151444612 shutdown_connections 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 --2- 172.21.15.144:0/3151444612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634010c160 0x7f634010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 --2- 172.21.15.144:0/3151444612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f634010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 --2- 172.21.15.144:0/3151444612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6340102d30 0x7f6340103110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 -- 172.21.15.144:0/3151444612 >> 172.21.15.144:0/3151444612 conn(0x7f63400fc7d0 msgr2=0x7f63400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:14.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 -- 172.21.15.144:0/3151444612 shutdown_connections 2024-09-05T07:51:14.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.991+0000 7f6345e00640 1 -- 172.21.15.144:0/3151444612 wait complete. 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 Processor -- start 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 -- start start 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 0x7f6340100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f6340100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634010c160 0x7f6340101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111fb0 con 0x7f634010c160 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111e30 con 0x7f6340102d30 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.992+0000 7f6345e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112130 con 0x7f6340103650 2024-09-05T07:51:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 0x7f6340100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f6340100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 0x7f6340100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:52870/0 (socket says 172.21.15.144:52870) 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633ea00640 1 -- 172.21.15.144:0/136010564 learned_addr learned my addr 172.21.15.144:0/136010564 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633f400640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634010c160 0x7f6340101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 -- 172.21.15.144:0/136010564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 msgr2=0x7f6340100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 0x7f6340100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 -- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634010c160 msgr2=0x7f6340101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634010c160 0x7f6340101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 -- 172.21.15.144:0/136010564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63401a6980 con 0x7f6340103650 2024-09-05T07:51:14.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.993+0000 7f633e000640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f6340100ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e7c0 tx=0x7f632c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:14.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.994+0000 7f6344a00640 1 -- 172.21.15.144:0/136010564 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c009530 con 0x7f6340103650 2024-09-05T07:51:14.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.994+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63401a6c70 con 0x7f6340103650 2024-09-05T07:51:14.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.994+0000 7f6344a00640 1 -- 172.21.15.144:0/136010564 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632c00ccc0 con 0x7f6340103650 2024-09-05T07:51:14.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.994+0000 7f6344a00640 1 -- 172.21.15.144:0/136010564 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c004a00 con 0x7f6340103650 2024-09-05T07:51:14.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.994+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a7160 con 0x7f6340103650 2024-09-05T07:51:14.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.997+0000 7f6348893740 1 Processor -- start 2024-09-05T07:51:14.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.997+0000 7f6344a00640 1 -- 172.21.15.144:0/136010564 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f632c004ba0 con 0x7f6340103650 2024-09-05T07:51:14.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.997+0000 7f6348893740 1 -- start start 2024-09-05T07:51:14.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.997+0000 7f6348893740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f6348893740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f6348893740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b2d510 0x559bc6b2f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f6348893740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559bc6a880b0 con 0x559bc6b22330 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f6348893740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559bc6a2fab0 con 0x559bc6b2d510 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f6348893740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bc6a84070 con 0x559bc6b22c50 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34126/0 (socket says 172.21.15.144:34126) 2024-09-05T07:51:14.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 -- 172.21.15.144:0/2040678929 learned_addr learned my addr 172.21.15.144:0/2040678929 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:15.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633ea00640 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633e000640 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b2d510 0x559bc6b2f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 -- 172.21.15.144:0/2040678929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 msgr2=0x559bc6b2cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 -- 172.21.15.144:0/2040678929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b2d510 msgr2=0x559bc6b2f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b2d510 0x559bc6b2f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.998+0000 7f633f400640 1 -- 172.21.15.144:0/2040678929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc6a3c4a0 con 0x559bc6b22330 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f633f400640 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6338009f90 tx=0x7f6338010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935104500aa291c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f6344a00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 0x7f63240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f632be00640 1 -- 172.21.15.144:0/2040678929 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338011700 con 0x559bc6b22330 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f632be00640 1 -- 172.21.15.144:0/2040678929 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6338011d80 con 0x559bc6b22330 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f632be00640 1 -- 172.21.15.144:0/2040678929 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338019e40 con 0x559bc6b22330 2024-09-05T07:51:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f6344a00640 1 -- 172.21.15.144:0/136010564 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f632c0cef70 con 0x7f6340103650 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:14.999+0000 7f633ea00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 0x7f63240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 -- 172.21.15.144:0/2040678929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 msgr2=0x559bc6b22710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6338009f90 tx=0x7f6338010860 comp rx=0 tx=0).stop 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f633ea00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 0x7f63240a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f63300096c0 tx=0x7f63300046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 -- 172.21.15.144:0/2040678929 shutdown_connections 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b2d510 0x559bc6b2f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 --2- 172.21.15.144:0/2040678929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b22330 0x559bc6b22710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 -- 172.21.15.144:0/2040678929 >> 172.21.15.144:0/2040678929 conn(0x559bc6b1e8c0 msgr2=0x559bc6b1eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 -- 172.21.15.144:0/2040678929 shutdown_connections 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.000+0000 7f6348893740 1 -- 172.21.15.144:0/2040678929 wait complete. 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 -- start start 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 Processor -- start 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b2a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b2af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b30060 con 0x559bc6b2d510 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559bc6a10920 con 0x559bc6b22330 2024-09-05T07:51:15.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b301e0 con 0x559bc6b22c50 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.001+0000 7f6348893740 10 client.0 _ll_register_callbacks cb 0x559bc6a348a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b2af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b2a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b2a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:52894/0 (socket says 172.21.15.144:52894) 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b2af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34128/0 (socket says 172.21.15.144:34128) 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633ea00640 1 -- 172.21.15.144:0/2812302724 learned_addr learned my addr 172.21.15.144:0/2812302724 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 -- 172.21.15.144:0/2812302724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 msgr2=0x559bc6b2a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b2a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 -- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 msgr2=0x559bc6b2af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b2af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 -- 172.21.15.144:0/2812302724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc67f92b0 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f633e000640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2aa50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cc9d0 tx=0x7f632c00cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b52dc892ccf2e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f6328c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.002+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c01c070 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f632c005020 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6338011d80 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f632c09b530 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 10 client.25072 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bc6b3be70 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6338011d80 con 0x559bc6b22c50 2024-09-05T07:51:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f632c09b9c0 con 0x559bc6b22c50 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 10 client.25072 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 10 client.25072 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 20 client.25072 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6b3e3e0 0x559bc6b3f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 4 client.25072 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.003+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 --> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bc6a95620 con 0x559bc6b3e3e0 2024-09-05T07:51:15.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.004+0000 7f633ea00640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6b3e3e0 0x559bc6b3f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.004+0000 7f633ea00640 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6b3e3e0 0x559bc6b3f850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2aa3ea04345005a server_cookie=a017ccc074aa20e7 in_seq=0 out_seq=0 2024-09-05T07:51:15.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.004+0000 7f6328c00640 10 client.25072 ms_handle_connect on v2:172.21.15.144:6840/1329376648 2024-09-05T07:51:15.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6328c00640 1 -- 172.21.15.144:0/2812302724 <== mds.2 v2:172.21.15.144:6840/1329376648 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bc6a95620 con 0x559bc6b3e3e0 2024-09-05T07:51:15.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6328c00640 10 client.25072 handle_command_reply: tid=0 2024-09-05T07:51:15.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 client.25072 shutdown 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 msgr2=0x559bc6b2aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2aa50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cc9d0 tx=0x7f632c00cf30 comp rx=0 tx=0).stop 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 shutdown_connections 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6b3e3e0 0x559bc6b3f850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b2af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b2aa50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 --2- 172.21.15.144:0/2812302724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b2a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 >> 172.21.15.144:0/2812302724 conn(0x559bc6b1e8c0 msgr2=0x559bc6b245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.005+0000 7f6328c00640 0 client.25072 ms_handle_reset on v2:172.21.15.144:6840/1329376648 2024-09-05T07:51:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.006+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 shutdown_connections 2024-09-05T07:51:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.006+0000 7f6348893740 1 -- 172.21.15.144:0/2812302724 wait complete. 2024-09-05T07:51:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.006+0000 7f6348893740 20 client.25072 trim_cache size 0 max 16384 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 Processor -- start 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 -- start start 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22330 0x559bc6b28de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 0x559bc6b29320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3db90 con 0x559bc6b2d510 2024-09-05T07:51:15.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3e260 con 0x559bc6b22c50 2024-09-05T07:51:15.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f6348893740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3e930 con 0x559bc6b22330 2024-09-05T07:51:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.025+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34136/0 (socket says 172.21.15.144:34136) 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 -- 172.21.15.144:0/3363670353 learned_addr learned my addr 172.21.15.144:0/3363670353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633ea00640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22330 0x559bc6b28de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633e000640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 0x559bc6b29320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 -- 172.21.15.144:0/3363670353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22330 msgr2=0x559bc6b28de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22330 0x559bc6b28de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 -- 172.21.15.144:0/3363670353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 msgr2=0x559bc6b29320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 0x559bc6b29320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 -- 172.21.15.144:0/3363670353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc6b28a60 con 0x559bc6b2d510 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633e000640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 0x559bc6b29320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f633f400640 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6338019970 tx=0x7f6338019ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383bdf7664a8f8bc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.026+0000 7f632b400640 1 -- 172.21.15.144:0/3363670353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338019b40 con 0x559bc6b2d510 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f632b400640 1 -- 172.21.15.144:0/3363670353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6338029070 con 0x559bc6b2d510 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f632b400640 1 -- 172.21.15.144:0/3363670353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338011500 con 0x559bc6b2d510 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 -- 172.21.15.144:0/3363670353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 msgr2=0x559bc6b27790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6338019970 tx=0x7f6338019ad0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 -- 172.21.15.144:0/3363670353 shutdown_connections 2024-09-05T07:51:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22c50 0x559bc6b29320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b27790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 --2- 172.21.15.144:0/3363670353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22330 0x559bc6b28de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 -- 172.21.15.144:0/3363670353 >> 172.21.15.144:0/3363670353 conn(0x559bc6b1e8c0 msgr2=0x559bc6b25830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.027+0000 7f6348893740 1 -- 172.21.15.144:0/3363670353 shutdown_connections 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.028+0000 7f6348893740 1 -- 172.21.15.144:0/3363670353 wait complete. 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.028+0000 7f6348893740 1 -- start start 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.028+0000 7f6348893740 1 Processor -- start 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.028+0000 7f6348893740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.028+0000 7f6348893740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f6348893740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f6348893740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3f6d0 con 0x559bc6b2d510 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f6348893740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3f000 con 0x559bc6b22330 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f6348893740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bc6b3fda0 con 0x559bc6b22c50 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f6348893740 10 client.0 _ll_register_callbacks cb 0x7f632c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:43482/0 (socket says 172.21.15.144:43482) 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 -- 172.21.15.144:0/3751140675 learned_addr learned my addr 172.21.15.144:0/3751140675 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 -- 172.21.15.144:0/3751140675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 msgr2=0x559bc6b276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 -- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 msgr2=0x559bc6b28140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b28140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633e000640 1 -- 172.21.15.144:0/3751140675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc6b460d0 con 0x559bc6b22c50 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.029+0000 7f633ea00640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f633e000640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f632c09b6f0 tx=0x7f632c005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4904aa16800c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c01c070 con 0x559bc6b22c50 2024-09-05T07:51:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f632c0d2110 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6338029070 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f632c09b0c0 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 10 client.25078 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bc6bb1620 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6338029070 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f632c09abb0 con 0x559bc6b22c50 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 10 client.25078 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 10 client.25078 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:51:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 20 client.25078 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6bb6250 0x559bc6bb4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 4 client.25078 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.030+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 --> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] -- command(tid 0: {"prefix": "status"}) -- 0x559bc6a8fb30 con 0x559bc6bb6250 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f633ea00640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6bb6250 0x559bc6bb4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f633ea00640 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6bb6250 0x559bc6bb4f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68e8454d2e9c64d server_cookie=8ad3d5e987b4abf1 in_seq=0 out_seq=0 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f6328c00640 10 client.25078 ms_handle_connect on v2:172.21.15.144:6840/1329376648 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f6328c00640 1 -- 172.21.15.144:0/3751140675 <== mds.2 v2:172.21.15.144:6840/1329376648 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559bc6a8fb30 con 0x559bc6bb6250 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f6328c00640 10 client.25078 handle_command_reply: tid=0 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.031+0000 7f6348893740 1 client.25078 shutdown 2024-09-05T07:51:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 msgr2=0x559bc6b27c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f632c09b6f0 tx=0x7f632c005250 comp rx=0 tx=0).stop 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 shutdown_connections 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:6840/1329376648,v1:172.21.15.144:6841/1329376648] conn(0x559bc6bb6250 0x559bc6bb4f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bc6b2d510 0x559bc6b28140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bc6b22c50 0x559bc6b27c00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6328c00640 0 client.25078 ms_handle_reset on v2:172.21.15.144:6840/1329376648 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 --2- 172.21.15.144:0/3751140675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559bc6b22330 0x559bc6b276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 >> 172.21.15.144:0/3751140675 conn(0x559bc6b1e8c0 msgr2=0x559bc6b28c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 shutdown_connections 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 1 -- 172.21.15.144:0/3751140675 wait complete. 2024-09-05T07:51:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.032+0000 7f6348893740 20 client.25078 trim_cache size 0 max 16384 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 2, 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24521, 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:51:15.044 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 109.704671331, 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 134.31878494899999 2024-09-05T07:51:15.045 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:51:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 msgr2=0x7f63240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 0x7f63240a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f63300096c0 tx=0x7f63300046c0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 msgr2=0x7f6340100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f6340100ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e7c0 tx=0x7f632c00ec80 comp rx=0 tx=0).stop 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 shutdown_connections 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f63240a2b80 0x7f63240a5040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634010c160 0x7f6340101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340103650 0x7f6340100ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 --2- 172.21.15.144:0/136010564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102d30 0x7f6340100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 >> 172.21.15.144:0/136010564 conn(0x7f63400fc7d0 msgr2=0x7f63400fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 shutdown_connections 2024-09-05T07:51:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:15.033+0000 7f6345e00640 1 -- 172.21.15.144:0/136010564 wait complete. 2024-09-05T07:51:15.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T07:51:16.214 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:16.636 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:16 smithi144 ceph-mon[29535]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 -- 172.21.15.144:0/4169863945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074590 msgr2=0x7fc6dc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/4169863945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074590 0x7fc6dc074970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009900 tx=0x7fc6d002a480 comp rx=0 tx=0).stop 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 -- 172.21.15.144:0/4169863945 shutdown_connections 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/4169863945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc112b90 0x7fc6dc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/4169863945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc074eb0 0x7fc6dc112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/4169863945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074590 0x7fc6dc074970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 -- 172.21.15.144:0/4169863945 >> 172.21.15.144:0/4169863945 conn(0x7fc6dc0fd8c0 msgr2=0x7fc6dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 -- 172.21.15.144:0/4169863945 shutdown_connections 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.745+0000 7fc6e3e00640 1 -- 172.21.15.144:0/4169863945 wait complete. 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.746+0000 7fc6e3e00640 1 Processor -- start 2024-09-05T07:51:16.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 -- start start 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074eb0 0x7fc6dc1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc112b90 0x7fc6dc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1185a0 con 0x7fc6dc074eb0 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc118420 con 0x7fc6dc074590 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc118720 con 0x7fc6dc112b90 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074eb0 0x7fc6dc1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e1400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e1400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:52924/0 (socket says 172.21.15.144:52924) 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e1400640 1 -- 172.21.15.144:0/868359383 learned_addr learned my addr 172.21.15.144:0/868359383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.747+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc112b90 0x7fc6dc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 -- 172.21.15.144:0/868359383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc112b90 msgr2=0x7fc6dc19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc112b90 0x7fc6dc19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 -- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074eb0 msgr2=0x7fc6dc1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074eb0 0x7fc6dc1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 -- 172.21.15.144:0/868359383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc19f000 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e1400640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0004770 tx=0x7fc6d0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6da000640 1 -- 172.21.15.144:0/868359383 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d003f070 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc19f290 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6da000640 1 -- 172.21.15.144:0/868359383 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d0031ca0 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6da000640 1 -- 172.21.15.144:0/868359383 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0035030 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.748+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1ab5e0 con 0x7fc6dc074590 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.751+0000 7fc6e69df740 1 Processor -- start 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.751+0000 7fc6e69df740 1 -- start start 2024-09-05T07:51:16.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.751+0000 7fc6da000640 1 -- 172.21.15.144:0/868359383 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc6d0042070 con 0x7fc6dc074590 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.751+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 0x55fac5d8efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d8f510 0x55fac5d91900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e69df740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fac5cea0b0 con 0x55fac5d84330 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e69df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5c91ab0 con 0x55fac5d8f510 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e69df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fac5ce6070 con 0x55fac5d84c50 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 0x55fac5d8efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34184/0 (socket says 172.21.15.144:34184) 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 -- 172.21.15.144:0/3155521971 learned_addr learned my addr 172.21.15.144:0/3155521971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d8f510 0x55fac5d91900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 -- 172.21.15.144:0/3155521971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 msgr2=0x55fac5d8efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 0x55fac5d8efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 -- 172.21.15.144:0/3155521971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d8f510 msgr2=0x55fac5d91900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d8f510 0x55fac5d91900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.752+0000 7fc6e1e00640 1 -- 172.21.15.144:0/3155521971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac5c9e4a0 con 0x55fac5d84330 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6e1400640 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 0x55fac5d8efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009f30 tx=0x7fc6d40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e329a9a4fbde33d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6ce600640 1 -- 172.21.15.144:0/3155521971 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4004d20 con 0x55fac5d84330 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6ce600640 1 -- 172.21.15.144:0/3155521971 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d4004050 con 0x55fac5d84330 2024-09-05T07:51:16.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6ce600640 1 -- 172.21.15.144:0/3155521971 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4005220 con 0x55fac5d84330 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.753+0000 7fc6da000640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 0x7fc6c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 -- 172.21.15.144:0/3155521971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 msgr2=0x55fac5d84710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009f30 tx=0x7fc6d40118d0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6da000640 1 -- 172.21.15.144:0/868359383 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fc6d00ef750 con 0x7fc6dc074590 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e1400640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 0x7fc6c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 -- 172.21.15.144:0/3155521971 shutdown_connections 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d8f510 0x55fac5d91900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d84c50 0x55fac5d8efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 --2- 172.21.15.144:0/3155521971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d84710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 -- 172.21.15.144:0/3155521971 >> 172.21.15.144:0/3155521971 conn(0x55fac5d808c0 msgr2=0x55fac5d80ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 -- 172.21.15.144:0/3155521971 shutdown_connections 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.754+0000 7fc6e69df740 1 -- 172.21.15.144:0/3155521971 wait complete. 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e1400640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 0x7fc6c40a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00b8450 tx=0x7fc6d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 -- start start 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 Processor -- start 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84c50 0x55fac5d8ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d8cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fac5d92060 con 0x55fac5d84330 2024-09-05T07:51:16.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5c72920 con 0x55fac5d84c50 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.755+0000 7fc6e69df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fac5d921e0 con 0x55fac5d8f510 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e69df740 10 client.0 _ll_register_callbacks cb 0x55fac5c968a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34198/0 (socket says 172.21.15.144:34198) 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 -- 172.21.15.144:0/2318746876 learned_addr learned my addr 172.21.15.144:0/2318746876 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84c50 0x55fac5d8ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d8cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 -- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 msgr2=0x55fac5d8cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d8cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 -- 172.21.15.144:0/2318746876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84c50 msgr2=0x55fac5d8ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84c50 0x55fac5d8ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 -- 172.21.15.144:0/2318746876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac5a5b2b0 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55fac5d8f4e0 tx=0x7fc6d4004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c405872f8001c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.756+0000 7fc6c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4004b00 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d4004050 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fc6d4004ca0 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6d4005040 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6e69df740 10 client.15084 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fac5d9ddd0 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d4004050 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6d4028640 con 0x55fac5d84330 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.757+0000 7fc6e69df740 10 client.15084 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e69df740 10 client.15084 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T07:51:16.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e69df740 20 client.15084 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5da01b0 0x55fac5da1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e69df740 4 client.15084 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 --> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fac5cf7620 con 0x55fac5da01b0 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.758+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5da01b0 0x55fac5da1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.759+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5da01b0 0x55fac5da1620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=808fe2674a747630 server_cookie=455c0567235e9284 in_seq=0 out_seq=0 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.759+0000 7fc6c2a00640 10 client.15084 ms_handle_connect on v2:172.21.15.175:6838/571012615 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.759+0000 7fc6c2a00640 1 -- 172.21.15.144:0/2318746876 <== mds.1 v2:172.21.15.175:6838/571012615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fac5cf7620 con 0x55fac5da01b0 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.759+0000 7fc6c2a00640 10 client.15084 handle_command_reply: tid=0 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.759+0000 7fc6e69df740 1 client.15084 shutdown 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 msgr2=0x55fac5d8c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55fac5d8f4e0 tx=0x7fc6d4004810 comp rx=0 tx=0).stop 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 shutdown_connections 2024-09-05T07:51:16.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84c50 0x55fac5d8ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5da01b0 0x55fac5da1620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d8cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 --2- 172.21.15.144:0/2318746876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84330 0x55fac5d8c540 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 >> 172.21.15.144:0/2318746876 conn(0x55fac5d808c0 msgr2=0x55fac5d865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6c2a00640 0 client.15084 ms_handle_reset on v2:172.21.15.175:6838/571012615 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 shutdown_connections 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 1 -- 172.21.15.144:0/2318746876 wait complete. 2024-09-05T07:51:16.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.760+0000 7fc6e69df740 20 client.15084 trim_cache size 0 max 16384 2024-09-05T07:51:16.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.778+0000 7fc6e69df740 1 Processor -- start 2024-09-05T07:51:16.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.778+0000 7fc6e69df740 1 -- start start 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.778+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.778+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e69df740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fac5d9f960 con 0x55fac5d84c50 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e69df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5da0030 con 0x55fac5d84330 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e69df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fac5da0700 con 0x55fac5d8f510 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34200/0 (socket says 172.21.15.144:34200) 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:52944/0 (socket says 172.21.15.144:52944) 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e0a00640 1 -- 172.21.15.144:0/1659260840 learned_addr learned my addr 172.21.15.144:0/1659260840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 -- 172.21.15.144:0/1659260840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 msgr2=0x55fac5d89d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 -- 172.21.15.144:0/1659260840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 msgr2=0x55fac5d897c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 -- 172.21.15.144:0/1659260840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac5d81550 con 0x55fac5d84330 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.779+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4002230 tx=0x7fc6d4004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6ff004bc2e07767 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6cdc00640 1 -- 172.21.15.144:0/1659260840 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4004510 con 0x55fac5d84330 2024-09-05T07:51:16.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6cdc00640 1 -- 172.21.15.144:0/1659260840 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d4028c30 con 0x55fac5d84330 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6cdc00640 1 -- 172.21.15.144:0/1659260840 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40051e0 con 0x55fac5d84330 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 -- 172.21.15.144:0/1659260840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 msgr2=0x55fac5d86d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4002230 tx=0x7fc6d4004300 comp rx=0 tx=0).stop 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 -- 172.21.15.144:0/1659260840 shutdown_connections 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d897c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 --2- 172.21.15.144:0/1659260840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5d86d90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.780+0000 7fc6e69df740 1 -- 172.21.15.144:0/1659260840 >> 172.21.15.144:0/1659260840 conn(0x55fac5d808c0 msgr2=0x55fac5d8ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.781+0000 7fc6e69df740 1 -- 172.21.15.144:0/1659260840 shutdown_connections 2024-09-05T07:51:16.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.781+0000 7fc6e69df740 1 -- 172.21.15.144:0/1659260840 wait complete. 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.781+0000 7fc6e69df740 1 -- start start 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.781+0000 7fc6e69df740 1 Processor -- start 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5da9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fac5da14a0 con 0x55fac5d84c50 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5da0dd0 con 0x55fac5d84330 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fac5da1b70 con 0x55fac5d8f510 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e69df740 10 client.0 _ll_register_callbacks cb 0x7fc6d4004460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34210/0 (socket says 172.21.15.144:34210) 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 -- 172.21.15.144:0/172162792 learned_addr learned my addr 172.21.15.144:0/172162792 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5da9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 -- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 msgr2=0x55fac5d89810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 -- 172.21.15.144:0/172162792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 msgr2=0x55fac5da9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5da9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e0a00640 1 -- 172.21.15.144:0/172162792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac5d89fe0 con 0x55fac5d84c50 2024-09-05T07:51:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.782+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6e0a00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55fac5d81c40 tx=0x7fc6c800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a63c1efad199ec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011440 con 0x55fac5d84c50 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fc6c80115e0 con 0x55fac5d84c50 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d4028c30 con 0x55fac5d84c50 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6c80117e0 con 0x55fac5d84c50 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6e69df740 10 client.15090 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fac5e0a8c0 con 0x55fac5d84c50 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d4028c30 con 0x55fac5d84c50 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.783+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6c8026b00 con 0x55fac5d84c50 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 10 client.15090 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 20 client.15090 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5e0f560 0x55fac5e0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:16.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 4 client.15090 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:51:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 --> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] -- command(tid 0: {"prefix": "status"}) -- 0x55fac5cf1b30 con 0x55fac5e0f560 2024-09-05T07:51:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5e0f560 0x55fac5e0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:16.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6e1e00640 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5e0f560 0x55fac5e0e270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eacf696082e49a63 server_cookie=111aad48986283a7 in_seq=0 out_seq=0 2024-09-05T07:51:16.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.784+0000 7fc6c2a00640 10 client.15090 ms_handle_connect on v2:172.21.15.175:6838/571012615 2024-09-05T07:51:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6c2a00640 1 -- 172.21.15.144:0/172162792 <== mds.1 v2:172.21.15.175:6838/571012615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55fac5cf1b30 con 0x55fac5e0f560 2024-09-05T07:51:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6c2a00640 10 client.15090 handle_command_reply: tid=0 2024-09-05T07:51:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 client.15090 shutdown 2024-09-05T07:51:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 msgr2=0x55fac5d892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55fac5d81c40 tx=0x7fc6c800be60 comp rx=0 tx=0).stop 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 shutdown_connections 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:6838/571012615,v1:172.21.15.175:6839/571012615] conn(0x55fac5e0f560 0x55fac5e0e270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fac5d8f510 0x55fac5d89810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fac5d84c50 0x55fac5d892d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 --2- 172.21.15.144:0/172162792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d84330 0x55fac5da9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6c2a00640 0 client.15090 ms_handle_reset on v2:172.21.15.175:6838/571012615 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 >> 172.21.15.144:0/172162792 conn(0x55fac5d808c0 msgr2=0x55fac5d9ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 shutdown_connections 2024-09-05T07:51:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 1 -- 172.21.15.144:0/172162792 wait complete. 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.785+0000 7fc6e69df740 20 client.15090 trim_cache size 0 max 16384 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 1, 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24523, 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 112.468837454, 2024-09-05T07:51:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:51:16.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:51:16.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:51:16.796 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 143.594254476 2024-09-05T07:51:16.796 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:51:16.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 msgr2=0x7fc6c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 0x7fc6c40a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00b8450 tx=0x7fc6d0009260 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 msgr2=0x7fc6dc1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0004770 tx=0x7fc6d0003c10 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 shutdown_connections 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fc6c40a2b80 0x7fc6c40a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6dc112b90 0x7fc6dc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6dc074eb0 0x7fc6dc1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 --2- 172.21.15.144:0/868359383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6dc074590 0x7fc6dc1a4710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 >> 172.21.15.144:0/868359383 conn(0x7fc6dc0fd8c0 msgr2=0x7fc6dc0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 shutdown_connections 2024-09-05T07:51:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:16.786+0000 7fc6e3e00640 1 -- 172.21.15.144:0/868359383 wait complete. 2024-09-05T07:51:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:16 smithi175 ceph-mon[34585]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:16 smithi154 ceph-mon[34710]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:17.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T07:51:18.007 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 -- 172.21.15.144:0/801092881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 msgr2=0x7f10ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 --2- 172.21.15.144:0/801092881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac1021c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f109c009900 tx=0x7f109c02a410 comp rx=0 tx=0).stop 2024-09-05T07:51:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 -- 172.21.15.144:0/801092881 shutdown_connections 2024-09-05T07:51:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 --2- 172.21.15.144:0/801092881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac106f10 0x7f10ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 --2- 172.21.15.144:0/801092881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac102790 0x7f10ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 --2- 172.21.15.144:0/801092881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac1021c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 -- 172.21.15.144:0/801092881 >> 172.21.15.144:0/801092881 conn(0x7f10ac0fd8c0 msgr2=0x7f10ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 -- 172.21.15.144:0/801092881 shutdown_connections 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.572+0000 7f10b0c00640 1 -- 172.21.15.144:0/801092881 wait complete. 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.573+0000 7f10b0c00640 1 Processor -- start 2024-09-05T07:51:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.573+0000 7f10b0c00640 1 -- start start 2024-09-05T07:51:18.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac102790 0x7f10ac19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac106f10 0x7f10ac19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac111f30 con 0x7f10ac101de0 2024-09-05T07:51:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac111db0 con 0x7f10ac102790 2024-09-05T07:51:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10b0c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac1120b0 con 0x7f10ac106f10 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34218/0 (socket says 172.21.15.144:34218) 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 -- 172.21.15.144:0/3129075751 learned_addr learned my addr 172.21.15.144:0/3129075751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a1400640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac102790 0x7f10ac19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10aa800640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac106f10 0x7f10ac19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 -- 172.21.15.144:0/3129075751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac106f10 msgr2=0x7f10ac19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac106f10 0x7f10ac19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 -- 172.21.15.144:0/3129075751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac102790 msgr2=0x7f10ac19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac102790 0x7f10ac19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.574+0000 7f10a9e00640 1 -- 172.21.15.144:0/3129075751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac19f600 con 0x7f10ac101de0 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10a3400640 1 -- 172.21.15.144:0/3129075751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c03f030 con 0x7f10ac101de0 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac19f890 con 0x7f10ac101de0 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10a3400640 1 -- 172.21.15.144:0/3129075751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c003ce0 con 0x7f10ac101de0 2024-09-05T07:51:18.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10a3400640 1 -- 172.21.15.144:0/3129075751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c035070 con 0x7f10ac101de0 2024-09-05T07:51:18.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.575+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1a71d0 con 0x7f10ac101de0 2024-09-05T07:51:18.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.578+0000 7f10a3400640 1 -- 172.21.15.144:0/3129075751 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f109c042030 con 0x7f10ac101de0 2024-09-05T07:51:18.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.578+0000 7f10b36c7740 1 Processor -- start 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.578+0000 7f10b36c7740 1 -- start start 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e640bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e640e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4e63670b0 con 0x55b4e640c510 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4e630eab0 con 0x55b4e6401c50 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10b36c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4e6363070 con 0x55b4e6401330 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10aa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e640e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10aa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:43568/0 (socket says 172.21.15.144:43568) 2024-09-05T07:51:18.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10aa800640 1 -- 172.21.15.144:0/3593568258 learned_addr learned my addr 172.21.15.144:0/3593568258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.579+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e640bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 -- 172.21.15.144:0/3593568258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 msgr2=0x55b4e640bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e640bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 -- 172.21.15.144:0/3593568258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 msgr2=0x55b4e640e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10a3400640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 0x7f10900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e640e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 -- 172.21.15.144:0/3593568258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e631b4a0 con 0x55b4e6401330 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10a3400640 1 -- 172.21.15.144:0/3129075751 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f109c0ef560 con 0x7f10ac101de0 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 0x7f10900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.580+0000 7f10aa800640 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009f50 tx=0x7f10a40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec406b93c1af579b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f109b000640 1 -- 172.21.15.144:0/3593568258 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a400f680 con 0x55b4e6401330 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f109b000640 1 -- 172.21.15.144:0/3593568258 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a4003cb0 con 0x55b4e6401330 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f109b000640 1 -- 172.21.15.144:0/3593568258 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a401bbd0 con 0x55b4e6401330 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 -- 172.21.15.144:0/3593568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 msgr2=0x55b4e6401710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10aa800640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 0x7f10900a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10a4012fd0 tx=0x7f10a4021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009f50 tx=0x7f10a40118d0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 -- 172.21.15.144:0/3593568258 shutdown_connections 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e640bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e640e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3593568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401330 0x55b4e6401710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 -- 172.21.15.144:0/3593568258 >> 172.21.15.144:0/3593568258 conn(0x55b4e63fd8c0 msgr2=0x55b4e63fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.581+0000 7f10b36c7740 1 -- 172.21.15.144:0/3593568258 shutdown_connections 2024-09-05T07:51:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.582+0000 7f10b36c7740 1 -- 172.21.15.144:0/3593568258 wait complete. 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.582+0000 7f10b36c7740 1 -- start start 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.582+0000 7f10b36c7740 1 Processor -- start 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6409a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e640c510 0x55b4e6409fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4e640f060 con 0x55b4e6401330 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4e62ef920 con 0x55b4e640c510 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4e640f1e0 con 0x55b4e6401c50 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10b36c7740 10 client.0 _ll_register_callbacks cb 0x55b4e63138a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34230/0 (socket says 172.21.15.144:34230) 2024-09-05T07:51:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 -- 172.21.15.144:0/3945914840 learned_addr learned my addr 172.21.15.144:0/3945914840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a1400640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6409a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10aa800640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e640c510 0x55b4e6409fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 -- 172.21.15.144:0/3945914840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 msgr2=0x55b4e6409a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6409a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 -- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e640c510 msgr2=0x55b4e6409fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e640c510 0x55b4e6409fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.583+0000 7f10a9e00640 1 -- 172.21.15.144:0/3945914840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e60d82b0 con 0x55b4e6401330 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f10a9e00640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f109c0c4550 tx=0x7f109c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae3b13fe987b8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f108f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c049070 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f109c0bc120 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4e6374620 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f109c0b8160 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f10b36c7740 10 client.15102 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4e641add0 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.584+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b4e6374620 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f109c0c45f0 con 0x55b4e6401330 2024-09-05T07:51:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 10 client.15102 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 10 client.15102 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 20 client.15102 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e641d480 0x55b4e641e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 4 client.15102 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4e636eb30 con 0x55b4e641d480 2024-09-05T07:51:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.585+0000 7f10a1400640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e641d480 0x55b4e641e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.586+0000 7f10a1400640 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e641d480 0x55b4e641e8f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99de6f91cd665f94 server_cookie=948c586a41d27234 in_seq=0 out_seq=0 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.586+0000 7f108f400640 10 client.15102 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.586+0000 7f108f400640 1 -- 172.21.15.144:0/3945914840 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4e636eb30 con 0x55b4e641d480 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.586+0000 7f108f400640 10 client.15102 handle_command_reply: tid=0 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.586+0000 7f10b36c7740 1 client.15102 shutdown 2024-09-05T07:51:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 msgr2=0x55b4e6409550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f109c0c4550 tx=0x7f109c005bd0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 shutdown_connections 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e641d480 0x55b4e641e8f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e640c510 0x55b4e6409fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6409a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 --2- 172.21.15.144:0/3945914840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6409550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f108f400640 0 client.15102 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:18.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 >> 172.21.15.144:0/3945914840 conn(0x55b4e63fd8c0 msgr2=0x55b4e64035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 shutdown_connections 2024-09-05T07:51:18.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 1 -- 172.21.15.144:0/3945914840 wait complete. 2024-09-05T07:51:18.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.587+0000 7f10b36c7740 20 client.15102 trim_cache size 0 max 16384 2024-09-05T07:51:18.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.605+0000 7f10b36c7740 1 Processor -- start 2024-09-05T07:51:18.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.605+0000 7f10b36c7740 1 -- start start 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e6407e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e640c510 0x55b4e6408360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641cc30 con 0x55b4e6401330 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641d300 con 0x55b4e6401c50 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10b36c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641d9d0 con 0x55b4e640c510 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34234/0 (socket says 172.21.15.144:34234) 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 -- 172.21.15.144:0/1547701015 learned_addr learned my addr 172.21.15.144:0/1547701015 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:18.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a1400640 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e6407e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10aa800640 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e640c510 0x55b4e6408360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 -- 172.21.15.144:0/1547701015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e640c510 msgr2=0x55b4e6408360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e640c510 0x55b4e6408360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 -- 172.21.15.144:0/1547701015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 msgr2=0x55b4e6407e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e6407e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.606+0000 7f10a9e00640 1 -- 172.21.15.144:0/1547701015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e640bec0 con 0x55b4e6401330 2024-09-05T07:51:18.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f10a9e00640 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f109c0f2d40 tx=0x7f109c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfc09417998e978 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f109a600640 1 -- 172.21.15.144:0/1547701015 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c049070 con 0x55b4e6401330 2024-09-05T07:51:18.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f109a600640 1 -- 172.21.15.144:0/1547701015 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c0c01c0 con 0x55b4e6401330 2024-09-05T07:51:18.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f109a600640 1 -- 172.21.15.144:0/1547701015 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0044e0 con 0x55b4e6401330 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f10b36c7740 1 -- 172.21.15.144:0/1547701015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 msgr2=0x55b4e6408e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.607+0000 7f10b36c7740 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f109c0f2d40 tx=0x7f109c02a410 comp rx=0 tx=0).stop 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 -- 172.21.15.144:0/1547701015 shutdown_connections 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401c50 0x55b4e6407e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e640c510 0x55b4e6408360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 --2- 172.21.15.144:0/1547701015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e6401330 0x55b4e6408e10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 -- 172.21.15.144:0/1547701015 >> 172.21.15.144:0/1547701015 conn(0x55b4e63fd8c0 msgr2=0x55b4e641c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 -- 172.21.15.144:0/1547701015 shutdown_connections 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 -- 172.21.15.144:0/1547701015 wait complete. 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 -- start start 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.608+0000 7f10b36c7740 1 Processor -- start 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6420490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e64209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641e770 con 0x55b4e640c510 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641e0a0 con 0x55b4e6401330 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4e641ee40 con 0x55b4e6401c50 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10b36c7740 10 client.0 _ll_register_callbacks cb 0x7f109c005750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:53008/0 (socket says 172.21.15.144:53008) 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10a9e00640 1 -- 172.21.15.144:0/2744024046 learned_addr learned my addr 172.21.15.144:0/2744024046 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10a1400640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6420490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.609+0000 7f10aa800640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e64209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 -- 172.21.15.144:0/2744024046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 msgr2=0x55b4e6420490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6420490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 -- 172.21.15.144:0/2744024046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 msgr2=0x55b4e64209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:18.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e64209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 -- 172.21.15.144:0/2744024046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e64210c0 con 0x55b4e6401330 2024-09-05T07:51:18.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10a9e00640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f109c005ab0 tx=0x7f109c0b8530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44401d3c897fb598 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:18.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f108f400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:51:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0d8020 con 0x55b4e6401330 2024-09-05T07:51:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f109c03bcc0 con 0x55b4e6401330 2024-09-05T07:51:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109c0c01c0 con 0x55b4e6401330 2024-09-05T07:51:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f109c049070 con 0x55b4e6401330 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10b36c7740 10 client.25106 fetch_fsmap learned FSMap version 28 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.610+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4e64210c0 con 0x55b4e6401330 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c0c01c0 con 0x55b4e6401330 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f109c0a6bd0 con 0x55b4e6401330 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 10 client.25106 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 10 client.25106 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 20 client.25106 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e648bea0 0x55b4e648abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 4 client.25106 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "status"}) -- 0x55b4e62eaf80 con 0x55b4e648bea0 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.611+0000 7f10a1400640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e648bea0 0x55b4e648abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10a1400640 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e648bea0 0x55b4e648abb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fe619fef7dd709 server_cookie=1d4148cf5d219a24 in_seq=0 out_seq=0 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f108f400640 10 client.25106 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f108f400640 1 -- 172.21.15.144:0/2744024046 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55b4e62eaf80 con 0x55b4e648bea0 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f108f400640 10 client.25106 handle_command_reply: tid=0 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 client.25106 shutdown 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 msgr2=0x55b4e6427160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f109c005ab0 tx=0x7f109c0b8530 comp rx=0 tx=0).stop 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 shutdown_connections 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55b4e648bea0 0x55b4e648abb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4e640c510 0x55b4e64209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f108f400640 0 client.25106 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4e6401c50 0x55b4e6420490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 --2- 172.21.15.144:0/2744024046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4e6401330 0x55b4e6427160 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 >> 172.21.15.144:0/2744024046 conn(0x55b4e63fd8c0 msgr2=0x55b4e6417430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 shutdown_connections 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 1 -- 172.21.15.144:0/2744024046 wait complete. 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.612+0000 7f10b36c7740 20 client.25106 trim_cache size 0 max 16384 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "17138d32-6b5a-11ef-bcd6-c7b262605968", 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 24533, 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-05T07:51:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 122.66234442, 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 28, 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 85, 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 135.183139238 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 msgr2=0x7f10900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 0x7f10900a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10a4012fd0 tx=0x7f10a4021000 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 msgr2=0x7f10ac19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c0042f0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 shutdown_connections 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f10900a2c00 0x7f10900a50c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac102790 0x7f10ac19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10ac106f10 0x7f10ac19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 --2- 172.21.15.144:0/3129075751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10ac101de0 0x7f10ac19a650 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 >> 172.21.15.144:0/3129075751 conn(0x7f10ac0fd8c0 msgr2=0x7f10ac0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 shutdown_connections 2024-09-05T07:51:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:18.613+0000 7f10b0c00640 1 -- 172.21.15.144:0/3129075751 wait complete. 2024-09-05T07:51:18.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:18 smithi144 ceph-mon[29535]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:18 smithi175 ceph-mon[34585]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:18.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:18 smithi154 ceph-mon[34710]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-05T07:51:19.405 INFO:teuthology.run_tasks:Running task sequential... 2024-09-05T07:51:19.417 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-05T07:51:19.417 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-05T07:51:19.417 INFO:teuthology.task.print:Enabling mgr modules 2024-09-05T07:51:19.417 INFO:teuthology.run_tasks:Running task kclient... 2024-09-05T07:51:19.444 INFO:tasks.kclient:Mounting kernel clients... 2024-09-05T07:51:19.445 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-05T07:51:19.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:19.445 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-05T07:51:19.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:19.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-05T07:51:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-05T07:51:19.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:51:19.584 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-05T07:51:19.584 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-05T07:51:19.585 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:19.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs ls 2024-09-05T07:51:19.951 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:51:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 -- 172.21.15.144:0/3537574610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8109120 msgr2=0x7f22c8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 --2- 172.21.15.144:0/3537574610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8109120 0x7f22c8110ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009ca0 tx=0x7f22c002a8c0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 -- 172.21.15.144:0/3537574610 shutdown_connections 2024-09-05T07:51:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 --2- 172.21.15.144:0/3537574610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8109120 0x7f22c8110ca0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 --2- 172.21.15.144:0/3537574610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 0x7f22c81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 --2- 172.21.15.144:0/3537574610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8103ff0 0x7f22c81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 -- 172.21.15.144:0/3537574610 >> 172.21.15.144:0/3537574610 conn(0x7f22c80ffa90 msgr2=0x7f22c8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.459+0000 7f22cf200640 1 -- 172.21.15.144:0/3537574610 shutdown_connections 2024-09-05T07:51:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.460+0000 7f22cf200640 1 -- 172.21.15.144:0/3537574610 wait complete. 2024-09-05T07:51:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.460+0000 7f22cf200640 1 Processor -- start 2024-09-05T07:51:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.460+0000 7f22cf200640 1 -- start start 2024-09-05T07:51:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 0x7f22c819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 0x7f22c819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 0x7f22c819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8114180 con 0x7f22c8103ff0 2024-09-05T07:51:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8114000 con 0x7f22c8109120 2024-09-05T07:51:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8114300 con 0x7f22c81049a0 2024-09-05T07:51:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 0x7f22c819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 0x7f22c819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34242/0 (socket says 172.21.15.144:34242) 2024-09-05T07:51:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22c7e00640 1 -- 172.21.15.144:0/1033376657 learned_addr learned my addr 172.21.15.144:0/1033376657 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22cd200640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 0x7f22c819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.461+0000 7f22c7400640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 0x7f22c819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 -- 172.21.15.144:0/1033376657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 msgr2=0x7f22c819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 0x7f22c819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 -- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 msgr2=0x7f22c819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 0x7f22c819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 -- 172.21.15.144:0/1033376657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c819f570 con 0x7f22c8109120 2024-09-05T07:51:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.462+0000 7f22cd200640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 0x7f22c819ee90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005e30 tx=0x7f22c0003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.463+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0031650 con 0x7f22c8109120 2024-09-05T07:51:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.463+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22c00317f0 con 0x7f22c8109120 2024-09-05T07:51:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.463+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c002fa30 con 0x7f22c8109120 2024-09-05T07:51:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.463+0000 7f22cf200640 1 -- 172.21.15.144:0/1033376657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c819f800 con 0x7f22c8109120 2024-09-05T07:51:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.463+0000 7f22cf200640 1 -- 172.21.15.144:0/1033376657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c81a7140 con 0x7f22c8109120 2024-09-05T07:51:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.464+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c81054d0 con 0x7f22c8109120 2024-09-05T07:51:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.466+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f22c002fbd0 con 0x7f22c8109120 2024-09-05T07:51:20.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.467+0000 7f22c4c00640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 0x7f22ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:20.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.468+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f22c00f0430 con 0x7f22c8109120 2024-09-05T07:51:20.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.468+0000 7f22c7e00640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 0x7f22ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:20.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.469+0000 7f22c7e00640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 0x7f22ac0a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009c90 tx=0x7f22b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:20.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.472+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22c00bd320 con 0x7f22c8109120 2024-09-05T07:51:20.690 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:20 smithi144 ceph-mon[29535]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:51:20.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.689+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22c819b920 con 0x7f22c8109120 2024-09-05T07:51:20.691 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-05T07:51:20.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.690+0000 7f22c4c00640 1 -- 172.21.15.144:0/1033376657 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f22c00319a0 con 0x7f22c8109120 2024-09-05T07:51:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 msgr2=0x7f22ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 0x7f22ac0a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009c90 tx=0x7f22b8005f90 comp rx=0 tx=0).stop 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 msgr2=0x7f22c819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 0x7f22c819ee90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005e30 tx=0x7f22c0003f10 comp rx=0 tx=0).stop 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 shutdown_connections 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f22ac0a2c00 0x7f22ac0a50c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8109120 0x7f22c819ee90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22c81049a0 0x7f22c819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 --2- 172.21.15.144:0/1033376657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c8103ff0 0x7f22c819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 >> 172.21.15.144:0/1033376657 conn(0x7f22c80ffa90 msgr2=0x7f22c81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.693+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 shutdown_connections 2024-09-05T07:51:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:20.694+0000 7f22be000640 1 -- 172.21.15.144:0/1033376657 wait complete. 2024-09-05T07:51:20.739 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:20 smithi154 ceph-mon[34710]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:51:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:20 smithi175 ceph-mon[34585]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:51:21.422 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-05T07:51:21.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-05T07:51:21.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-05T07:51:21.422 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-05T07:51:21.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:21.423 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-05T07:51:21.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-05T07:51:21.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-05T07:51:21.423 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-05T07:51:21.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:21.423 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-05T07:51:21.460 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42146sec preferred_lft 42146sec 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-05T07:51:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:51:21.462 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-05T07:51:21.462 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-05T07:51:21.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:21.748 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:21 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1033376657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T07:51:21.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:21 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1033376657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T07:51:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:21.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:21.898 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-05T07:51:21.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:21 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1033376657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T07:51:21.953 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-05T07:51:21.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:21.957 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-05T07:51:22.003 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-05T07:51:22.004 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-05T07:51:22.004 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-05T07:51:22.004 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-05T07:51:22.004 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-05T07:51:22.004 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:51:22.005 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-05T07:51:22.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-05T07:51:22.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-05T07:51:22.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-05T07:51:22.005 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-05T07:51:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:22.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:22.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:22.611 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-05T07:51:22.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:22.647 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-05T07:51:22.723 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:51:22.723 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-05T07:51:22.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:51:22.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-05T07:51:22.724 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-05T07:51:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:22 smithi144 ceph-mon[29535]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T07:51:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:22 smithi175 ceph-mon[34585]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T07:51:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:22.900 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-05T07:51:22.901 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-05T07:51:22.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:22 smithi154 ceph-mon[34710]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T07:51:22.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:23.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:23.142 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:51:23.142 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-05T07:51:23.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-05T07:51:23.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-09-05T07:51:23.142 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-05T07:51:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:23.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T07:51:23.310 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:23.346 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-05T07:51:23.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T07:51:23.346 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:23.422 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-05T07:51:23.422 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-05T07:51:23.422 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/e2396d72-2b7f-4b5e-8ff9-57cbc3a420d2 2024-09-05T07:51:23.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:23.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/e2396d72-2b7f-4b5e-8ff9-57cbc3a420d2 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-05T07:51:23.570 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-05T07:51:23.570 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-05T07:51:24.207 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-05T07:51:24.207 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-05T07:51:24.207 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.154:3300,172.21.15.175:3300" 2024-09-05T07:51:24.207 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@17138d32-6b5a-11ef-bcd6-c7b262605968.cephfs=/volumes/qa/sv_1/e2396d72-2b7f-4b5e-8ff9-57cbc3a420d2 2024-09-05T07:51:24.207 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.144:3300/172.21.15.154:3300/172.21.15.175:3300" will pass to kernel 2024-09-05T07:51:24.210 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-05T07:51:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-05T07:51:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-05T07:51:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-05T07:51:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-05T07:51:24.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-05T07:51:24.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:51:24.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:24.277 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T07:51:24.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T07:51:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:24.368 INFO:teuthology.orchestra.run.smithi144.stdout:client15117 2024-09-05T07:51:24.369 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:51:24.369 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:51:24.406 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T07:51:24.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T07:51:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:24.537 INFO:teuthology.orchestra.run.smithi144.stdout:client15117 2024-09-05T07:51:24.538 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T07:51:24.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T07:51:24.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:24.627 INFO:teuthology.orchestra.run.smithi144.stdout:client15117 2024-09-05T07:51:24.628 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968.client15117/status') 2024-09-05T07:51:24.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:51:24.725 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:24 smithi144 ceph-mon[29535]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:24.728 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.15117 (3)192.168.0.1:0/773824878 2024-09-05T07:51:24.728 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-09-05T07:51:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-09-05T07:51:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-09-05T07:51:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:69 bytes copied, 7.256e-05 s, 951 kB/s 2024-09-05T07:51:24.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:51:24.739 INFO:teuthology.run_tasks:Running task exec... 2024-09-05T07:51:24.749 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T07:51:24.749 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:51:24.750 DEBUG:teuthology.orchestra.run.smithi144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-05T07:51:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:24 smithi175 ceph-mon[34585]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:24.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.902+0000 7f64b2400640 1 -- 172.21.15.144:0/778847044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac101490 msgr2=0x7f64ac101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.902+0000 7f64b2400640 1 --2- 172.21.15.144:0/778847044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac101490 0x7f64ac101940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009be0 tx=0x7f64a402a6c0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 -- 172.21.15.144:0/778847044 shutdown_connections 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 --2- 172.21.15.144:0/778847044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac101490 0x7f64ac101940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 --2- 172.21.15.144:0/778847044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac100af0 0x7f64ac100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 --2- 172.21.15.144:0/778847044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 0x7f64ac1005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 -- 172.21.15.144:0/778847044 >> 172.21.15.144:0/778847044 conn(0x7f64ac0fbfa0 msgr2=0x7f64ac0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 -- 172.21.15.144:0/778847044 shutdown_connections 2024-09-05T07:51:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.903+0000 7f64b2400640 1 -- 172.21.15.144:0/778847044 wait complete. 2024-09-05T07:51:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 Processor -- start 2024-09-05T07:51:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 -- start start 2024-09-05T07:51:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 0x7f64ac199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 0x7f64ac19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac10f790 con 0x7f64ac101490 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac10f610 con 0x7f64ac100af0 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b2400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac10f910 con 0x7f64ac1001b0 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64abe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 0x7f64ac19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53598/0 (socket says 172.21.15.144:53598) 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64abe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 0x7f64ac19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:44628/0 (socket says 172.21.15.144:44628) 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b1a00640 1 -- 172.21.15.144:0/2766365659 learned_addr learned my addr 172.21.15.144:0/2766365659 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.904+0000 7f64b1000640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 0x7f64ac199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 -- 172.21.15.144:0/2766365659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 msgr2=0x7f64ac199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 0x7f64ac199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 -- 172.21.15.144:0/2766365659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 msgr2=0x7f64ac19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 0x7f64ac19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 -- 172.21.15.144:0/2766365659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac1a1a30 con 0x7f64ac101490 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b1a00640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009b30 tx=0x7f64a40305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4041020 con 0x7f64ac101490 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a4030740 con 0x7f64ac101490 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac1a1cc0 con 0x7f64ac101490 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.905+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4036040 con 0x7f64ac101490 2024-09-05T07:51:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.906+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1a21b0 con 0x7f64ac101490 2024-09-05T07:51:24.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.906+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac10af00 con 0x7f64ac101490 2024-09-05T07:51:24.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.908+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f64a4044020 con 0x7f64ac101490 2024-09-05T07:51:24.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.909+0000 7f64a9600640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 0x7f64940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:24.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.910+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f64a40efd70 con 0x7f64ac101490 2024-09-05T07:51:24.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.910+0000 7f64b1000640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 0x7f64940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:24.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.910+0000 7f64b1000640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 0x7f64940a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009bd0 tx=0x7f64a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:24.914+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64a404b020 con 0x7f64ac101490 2024-09-05T07:51:24.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:24 smithi154 ceph-mon[34710]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T07:51:25.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.125+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f64ac062e20 con 0x7f64ac101490 2024-09-05T07:51:25.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.479+0000 7f64a9600640 1 -- 172.21.15.144:0/2766365659 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f64a40bcc60 con 0x7f64ac101490 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 msgr2=0x7f64940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 0x7f64940a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009bd0 tx=0x7f64a0005f90 comp rx=0 tx=0).stop 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 msgr2=0x7f64ac1a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009b30 tx=0x7f64a40305d0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 shutdown_connections 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f64940a2b80 0x7f64940a5040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ac100af0 0x7f64ac19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64ac101490 0x7f64ac1a13c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 --2- 172.21.15.144:0/2766365659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64ac1001b0 0x7f64ac199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 >> 172.21.15.144:0/2766365659 conn(0x7f64ac0fbfa0 msgr2=0x7f64ac0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 shutdown_connections 2024-09-05T07:51:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.482+0000 7f64b2400640 1 -- 172.21.15.144:0/2766365659 wait complete. 2024-09-05T07:51:25.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 -- 172.21.15.144:0/2133322880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4104f50 msgr2=0x7f13a41053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 --2- 172.21.15.144:0/2133322880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4104f50 0x7f13a41053d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1390009860 tx=0x7f139002a340 comp rx=0 tx=0).stop 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 -- 172.21.15.144:0/2133322880 shutdown_connections 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 --2- 172.21.15.144:0/2133322880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4104f50 0x7f13a41053d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 --2- 172.21.15.144:0/2133322880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4105910 0x7f13a410c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 --2- 172.21.15.144:0/2133322880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4103d60 0x7f13a4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 -- 172.21.15.144:0/2133322880 >> 172.21.15.144:0/2133322880 conn(0x7f13a40ff4e0 msgr2=0x7f13a4101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 -- 172.21.15.144:0/2133322880 shutdown_connections 2024-09-05T07:51:25.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.654+0000 7f13abe00640 1 -- 172.21.15.144:0/2133322880 wait complete. 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 Processor -- start 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 -- start start 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 0x7f13a4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4104f50 0x7f13a419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13a410f9c0 con 0x7f13a4105910 2024-09-05T07:51:25.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13a410f840 con 0x7f13a4103d60 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13abe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13a410fb40 con 0x7f13a4104f50 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53620/0 (socket says 172.21.15.144:53620) 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13a9e00640 1 -- 172.21.15.144:0/1239582468 learned_addr learned my addr 172.21.15.144:0/1239582468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.655+0000 7f13a9400640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 0x7f13a4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a8a00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4104f50 0x7f13a419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 -- 172.21.15.144:0/1239582468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4104f50 msgr2=0x7f13a419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4104f50 0x7f13a419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 -- 172.21.15.144:0/1239582468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 msgr2=0x7f13a4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 0x7f13a4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 -- 172.21.15.144:0/1239582468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a41a1bd0 con 0x7f13a4105910 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9400640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 0x7f13a4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a9e00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f139c009fd0 tx=0x7f139c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c017070 con 0x7f13a4105910 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.656+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c003e50 con 0x7f13a4105910 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.657+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a41a1ec0 con 0x7f13a4105910 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.657+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c0106c0 con 0x7f13a4105910 2024-09-05T07:51:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.657+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a41a2330 con 0x7f13a4105910 2024-09-05T07:51:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.658+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a410b0a0 con 0x7f13a4105910 2024-09-05T07:51:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.660+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f139c003970 con 0x7f13a4105910 2024-09-05T07:51:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.661+0000 7f13a2000640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.661+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f139c0ceda0 con 0x7f13a4105910 2024-09-05T07:51:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.661+0000 7f13a9400640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.662+0000 7f13a9400640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 0x7f138c0a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13980096c0 tx=0x7f1398009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.665+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f139c09b640 con 0x7f13a4105910 2024-09-05T07:51:25.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-05T07:51:25.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:25 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-05T07:51:25.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.864+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 --> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f13a4062790 con 0x7f138c0a2c30 2024-09-05T07:51:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.886+0000 7f13a2000640 1 -- 172.21.15.144:0/1239582468 <== mgr.14150 v2:172.21.15.144:6800/2361768482 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f13a4062790 con 0x7f138c0a2c30 2024-09-05T07:51:25.887 INFO:teuthology.orchestra.run.smithi144.stdout:{} 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 msgr2=0x7f138c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 0x7f138c0a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13980096c0 tx=0x7f1398009260 comp rx=0 tx=0).stop 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 msgr2=0x7f13a41a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f139c009fd0 tx=0x7f139c00b260 comp rx=0 tx=0).stop 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 shutdown_connections 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f138c0a2c30 0x7f138c0a50f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13a4105910 0x7f13a41a1560 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a4104f50 0x7f13a419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 --2- 172.21.15.144:0/1239582468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a4103d60 0x7f13a4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:25.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 >> 172.21.15.144:0/1239582468 conn(0x7f13a40ff4e0 msgr2=0x7f13a4108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:25.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 shutdown_connections 2024-09-05T07:51:25.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:51:25.888+0000 7f13abe00640 1 -- 172.21.15.144:0/1239582468 wait complete. 2024-09-05T07:51:25.905 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-05T07:51:25.917 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-05T07:51:25.928 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:51:25.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-05T07:51:25.932 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T07:51:25.947 INFO:tasks.workunit:Pulling workunits from ref 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:51:25.947 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T07:51:25.947 INFO:tasks.workunit:timeout=3h 2024-09-05T07:51:25.948 INFO:tasks.workunit:cleanup=True 2024-09-05T07:51:25.948 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:25.949 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:25 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-05T07:51:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-05T07:51:25.986 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-05T07:51:25.986 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:51:25.987 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-05T07:51:25.987 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-05 07:49:37.628806202 +0000 2024-09-05T07:51:25.987 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-05 07:49:37.628806202 +0000 2024-09-05T07:51:25.987 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-05 07:51:24.266274492 +0000 2024-09-05T07:51:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-05 07:49:37.628806202 +0000 2024-09-05T07:51:25.987 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-05T07:51:25.987 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-05T07:51:26.095 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:51:26.132 INFO:tasks.workunit.client.0.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T07:51:26.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:51:25.870+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:51:26.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:51:25.870+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:51:26.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:51:25.870+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:51:26.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:51:25.870+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:51:26.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:51:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:51:25.870+0000 7fa78fa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T07:51:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:26 smithi144 ceph-mon[29535]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T07:51:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:26 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-05T07:51:26.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:26 smithi144 ceph-mon[29535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:51:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:26 smithi175 ceph-mon[34585]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T07:51:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:26 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-05T07:51:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:26 smithi175 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:51:26.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:26 smithi154 ceph-mon[34710]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T07:51:26.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:26 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2766365659' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-05T07:51:26.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:26 smithi154 ceph-mon[34710]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T07:51:27.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:27 smithi144 ceph-mon[29535]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:27.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:27 smithi175 ceph-mon[34585]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:27.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:27 smithi154 ceph-mon[34710]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T07:51:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:28 smithi144 ceph-mon[29535]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:28 smithi144 ceph-mon[29535]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T07:51:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:28 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:51:28.823 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:28 smithi154 ceph-mon[34710]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:28.823 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:28 smithi154 ceph-mon[34710]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T07:51:28.823 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:28 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:51:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:28 smithi175 ceph-mon[34585]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:28 smithi175 ceph-mon[34585]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T07:51:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:28 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:51:30.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:30 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:30 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:30.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:30.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:30 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:31.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:51:31.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:51:31.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:51:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:51:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:31.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:51:31.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:51:31.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:51:32.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:32 smithi144 ceph-mon[29535]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-05T07:51:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:32 smithi175 ceph-mon[34585]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-05T07:51:32.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:32 smithi154 ceph-mon[34710]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-05T07:51:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:34 smithi144 ceph-mon[29535]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-05T07:51:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:34 smithi175 ceph-mon[34585]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-05T07:51:34.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:34 smithi154 ceph-mon[34710]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-05T07:51:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:36 smithi144 ceph-mon[29535]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-05T07:51:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:36 smithi175 ceph-mon[34585]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-05T07:51:36.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:36 smithi154 ceph-mon[34710]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-05T07:51:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:38 smithi144 ceph-mon[29535]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-05T07:51:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:38 smithi175 ceph-mon[34585]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-05T07:51:38.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:38 smithi154 ceph-mon[34710]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-05T07:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 -- 172.21.15.144:0/657166853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638103b70 msgr2=0x7fa638103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 --2- 172.21.15.144:0/657166853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638103b70 0x7fa638103f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa628009900 tx=0x7fa62802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 -- 172.21.15.144:0/657166853 shutdown_connections 2024-09-05T07:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 --2- 172.21.15.144:0/657166853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 0x7fa63810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 --2- 172.21.15.144:0/657166853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638104d60 0x7fa6381051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 --2- 172.21.15.144:0/657166853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638103b70 0x7fa638103f70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 -- 172.21.15.144:0/657166853 >> 172.21.15.144:0/657166853 conn(0x7fa6380ff2f0 msgr2=0x7fa638101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 -- 172.21.15.144:0/657166853 shutdown_connections 2024-09-05T07:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.133+0000 7fa637200640 1 -- 172.21.15.144:0/657166853 wait complete. 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.134+0000 7fa637200640 1 Processor -- start 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.134+0000 7fa637200640 1 -- start start 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.134+0000 7fa637200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 0x7fa638199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.134+0000 7fa637200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.134+0000 7fa637200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 0x7fa6381a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa637200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa63810f840 con 0x7fa638104d60 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa637200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa63810f6c0 con 0x7fa638105720 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa637200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa63810f9c0 con 0x7fa638103b70 2024-09-05T07:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49350/0 (socket says 172.21.15.144:49350) 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 -- 172.21.15.144:0/2546379587 learned_addr learned my addr 172.21.15.144:0/2546379587 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635e00640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 0x7fa638199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa636800640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 0x7fa6381a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 -- 172.21.15.144:0/2546379587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 msgr2=0x7fa638199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 0x7fa638199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 -- 172.21.15.144:0/2546379587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 msgr2=0x7fa6381a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 0x7fa6381a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635400640 1 -- 172.21.15.144:0/2546379587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6381a1ae0 con 0x7fa638104d60 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.135+0000 7fa635e00640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 0x7fa638199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa635400640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa62400e9f0 tx=0x7fa62400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa62ea00640 1 -- 172.21.15.144:0/2546379587 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62400ccc0 con 0x7fa638104d60 2024-09-05T07:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa62ea00640 1 -- 172.21.15.144:0/2546379587 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa62400ce60 con 0x7fa638104d60 2024-09-05T07:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa62ea00640 1 -- 172.21.15.144:0/2546379587 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624010690 con 0x7fa638104d60 2024-09-05T07:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6381a1dd0 con 0x7fa638104d60 2024-09-05T07:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.136+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6381a2240 con 0x7fa638104d60 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.139+0000 7fa63fa47740 1 Processor -- start 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.139+0000 7fa62ea00640 1 -- 172.21.15.144:0/2546379587 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fa6240046c0 con 0x7fa638104d60 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.139+0000 7fa63fa47740 1 -- start start 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810ba0 0x562893815660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893815c30 0x5628938180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562893775100 con 0x562893810260 2024-09-05T07:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56289371d1b0 con 0x562893810ba0 2024-09-05T07:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa63fa47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628937710c0 con 0x562893815c30 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa636800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa636800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49360/0 (socket says 172.21.15.144:49360) 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa636800640 1 -- 172.21.15.144:0/659955866 learned_addr learned my addr 172.21.15.144:0/659955866 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa635400640 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893815c30 0x5628938180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.140+0000 7fa635e00640 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810ba0 0x562893815660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 -- 172.21.15.144:0/659955866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893815c30 msgr2=0x5628938180f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893815c30 0x5628938180f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 -- 172.21.15.144:0/659955866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810ba0 msgr2=0x562893815660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810ba0 0x562893815660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 -- 172.21.15.144:0/659955866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562893488210 con 0x562893810260 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa636800640 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa630011440 tx=0x7fa630011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbd80db11b8f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa62ea00640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 0x7fa61c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa623000640 1 -- 172.21.15.144:0/659955866 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630003c30 con 0x562893810260 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa62ea00640 1 -- 172.21.15.144:0/2546379587 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa6240cf590 con 0x7fa638104d60 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa623000640 1 -- 172.21.15.144:0/659955866 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa630003dd0 con 0x562893810260 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa623000640 1 -- 172.21.15.144:0/659955866 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63000fb10 con 0x562893810260 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.141+0000 7fa635e00640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 0x7fa61c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 -- 172.21.15.144:0/659955866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 msgr2=0x562893810660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa630011440 tx=0x7fa630011900 comp rx=0 tx=0).stop 2024-09-05T07:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa635e00640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 0x7fa61c0a5150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa62802a9e0 tx=0x7fa6280315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 -- 172.21.15.144:0/659955866 shutdown_connections 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810ba0 0x562893815660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893815c30 0x5628938180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 --2- 172.21.15.144:0/659955866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x562893810660 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 -- 172.21.15.144:0/659955866 >> 172.21.15.144:0/659955866 conn(0x56289380b8d0 msgr2=0x56289380bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 -- 172.21.15.144:0/659955866 shutdown_connections 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.142+0000 7fa63fa47740 1 -- 172.21.15.144:0/659955866 wait complete. 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 -- start start 2024-09-05T07:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 Processor -- start 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x562893821970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562893818c00 con 0x562893815c30 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628936fe090 con 0x562893810260 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562893818d80 con 0x562893810ba0 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa63fa47740 10 client.0 _ll_register_callbacks cb 0x562893752f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa635e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa636800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x562893821970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.143+0000 7fa635e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:57940/0 (socket says 172.21.15.144:57940) 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 -- 172.21.15.144:0/1066475195 learned_addr learned my addr 172.21.15.144:0/1066475195 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635400640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 -- 172.21.15.144:0/1066475195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 msgr2=0x56289381a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 -- 172.21.15.144:0/1066475195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 msgr2=0x562893821970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x562893821970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 -- 172.21.15.144:0/1066475195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562893554620 con 0x562893810260 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa636800640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x562893821970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa635e00640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa628009900 tx=0x7fa628009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e541589cb53f7008 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa617400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.144+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628035040 con 0x562893810260 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa630003dd0 con 0x562893810260 2024-09-05T07:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa6280316b0 con 0x562893810260 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa6280318b0 con 0x562893810260 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 10 client.25142 fetch_fsmap learned FSMap version 29 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562893824820 con 0x562893810260 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa630003dd0 con 0x562893810260 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa628044030 con 0x562893810260 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 10 client.25142 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 10 client.25142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 20 client.25142 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893825ea0 0x562893828310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 4 client.25142 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.145+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562893782830 con 0x562893825ea0 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.146+0000 7fa635400640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893825ea0 0x562893828310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.146+0000 7fa635400640 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893825ea0 0x562893828310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118345843c85396b server_cookie=e841c459ca804ebe in_seq=0 out_seq=0 2024-09-05T07:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.146+0000 7fa617400640 10 client.25142 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa617400640 1 -- 172.21.15.144:0/1066475195 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562893782830 con 0x562893825ea0 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa617400640 10 client.25142 handle_command_reply: tid=0 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 client.25142 shutdown 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 msgr2=0x56289381a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa628009900 tx=0x7fa628009260 comp rx=0 tx=0).stop 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 shutdown_connections 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893825ea0 0x562893828310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x562893821970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa617400640 0 client.25142 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1066475195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 >> 172.21.15.144:0/1066475195 conn(0x56289380b8d0 msgr2=0x56289380d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 shutdown_connections 2024-09-05T07:51:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.147+0000 7fa63fa47740 1 -- 172.21.15.144:0/1066475195 wait complete. 2024-09-05T07:51:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.148+0000 7fa63fa47740 20 client.25142 trim_cache size 0 max 16384 2024-09-05T07:51:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.162+0000 7fa63fa47740 1 Processor -- start 2024-09-05T07:51:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 -- start start 2024-09-05T07:51:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x562893821930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381ab030 con 0x562893815c30 2024-09-05T07:51:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381acb70 con 0x562893810260 2024-09-05T07:51:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa63fa47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381ab700 con 0x562893810ba0 2024-09-05T07:51:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49370/0 (socket says 172.21.15.144:49370) 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 -- 172.21.15.144:0/1664155236 learned_addr learned my addr 172.21.15.144:0/1664155236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa635400640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x562893821930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa635e00640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 -- 172.21.15.144:0/1664155236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 msgr2=0x562893821930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x562893821930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 -- 172.21.15.144:0/1664155236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 msgr2=0x56289381a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa636800640 1 -- 172.21.15.144:0/1664155236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562893819480 con 0x562893815c30 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.163+0000 7fa635e00640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.164+0000 7fa636800640 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa63001b040 tx=0x7fa630009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2f4f684f51cb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.164+0000 7fa622600640 1 -- 172.21.15.144:0/1664155236 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63000f740 con 0x562893815c30 2024-09-05T07:51:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.164+0000 7fa622600640 1 -- 172.21.15.144:0/1664155236 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63000fdc0 con 0x562893815c30 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.164+0000 7fa622600640 1 -- 172.21.15.144:0/1664155236 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630019430 con 0x562893815c30 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- 172.21.15.144:0/1664155236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 msgr2=0x56289380bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa63001b040 tx=0x7fa630009940 comp rx=0 tx=0).stop 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- 172.21.15.144:0/1664155236 shutdown_connections 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893815c30 0x56289380bcb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x562893821930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 --2- 172.21.15.144:0/1664155236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893810260 0x56289381a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- 172.21.15.144:0/1664155236 >> 172.21.15.144:0/1664155236 conn(0x56289380b8d0 msgr2=0x5628938066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- 172.21.15.144:0/1664155236 shutdown_connections 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- 172.21.15.144:0/1664155236 wait complete. 2024-09-05T07:51:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 -- start start 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.165+0000 7fa63fa47740 1 Processor -- start 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 0x5628938203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381ac4a0 con 0x562893810260 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381abdd0 con 0x562893815c30 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381a9010 con 0x562893810ba0 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa63fa47740 10 client.0 _ll_register_callbacks cb 0x7fa628009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49372/0 (socket says 172.21.15.144:49372) 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 -- 172.21.15.144:0/3751008896 learned_addr learned my addr 172.21.15.144:0/3751008896 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635400640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa636800640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 0x5628938203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 -- 172.21.15.144:0/3751008896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 msgr2=0x56289381f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 -- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 msgr2=0x5628938203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 0x5628938203f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa635e00640 1 -- 172.21.15.144:0/3751008896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562893820a00 con 0x562893810260 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.166+0000 7fa636800640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 0x5628938203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa635e00640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa628009230 tx=0x7fa62803d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99049ad69692ee01 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa617400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628031c60 con 0x562893810260 2024-09-05T07:51:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa62803da30 con 0x562893810260 2024-09-05T07:51:39.171 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa63000fdc0 con 0x562893810260 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa62806c050 con 0x562893810260 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa63fa47740 10 client.15153 fetch_fsmap learned FSMap version 29 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.167+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562893821d10 con 0x562893810260 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63000fdc0 con 0x562893810260 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa628044040 con 0x562893810260 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 10 client.15153 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 10 client.15153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 20 client.15153 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893891370 0x562893893790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 4 client.15153 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:51:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56289377cb80 con 0x562893891370 2024-09-05T07:51:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.168+0000 7fa635400640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893891370 0x562893893790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.169+0000 7fa635400640 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893891370 0x562893893790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e643152ae33c9c1c server_cookie=3f16e376f3046969 in_seq=0 out_seq=0 2024-09-05T07:51:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.169+0000 7fa617400640 10 client.15153 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa617400640 1 -- 172.21.15.144:0/3751008896 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56289377cb80 con 0x562893891370 2024-09-05T07:51:39.180 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa617400640 10 client.15153 handle_command_reply: tid=0 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 client.15153 shutdown 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 msgr2=0x56289381eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa628009230 tx=0x7fa62803d7c0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 shutdown_connections 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x562893891370 0x562893893790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa617400640 0 client.15153 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562893815c30 0x5628938203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562893810ba0 0x56289381f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 --2- 172.21.15.144:0/3751008896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562893810260 0x56289381eea0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 >> 172.21.15.144:0/3751008896 conn(0x56289380b8d0 msgr2=0x56289380a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 shutdown_connections 2024-09-05T07:51:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.180+0000 7fa63fa47740 1 -- 172.21.15.144:0/3751008896 wait complete. 2024-09-05T07:51:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa63fa47740 20 client.15153 trim_cache size 0 max 16384 2024-09-05T07:51:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:51:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:51:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:51:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 msgr2=0x7fa61c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 0x7fa61c0a5150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa62802a9e0 tx=0x7fa6280315b0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 msgr2=0x7fa63819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa62400e9f0 tx=0x7fa62400edf0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 shutdown_connections 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa61c0a2c90 0x7fa61c0a5150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa638105720 0x7fa6381a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa638104d60 0x7fa63819a400 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 --2- 172.21.15.144:0/2546379587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa638103b70 0x7fa638199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 >> 172.21.15.144:0/2546379587 conn(0x7fa6380ff2f0 msgr2=0x7fa638108100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 shutdown_connections 2024-09-05T07:51:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:39.181+0000 7fa637200640 1 -- 172.21.15.144:0/2546379587 wait complete. 2024-09-05T07:51:40.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:40 smithi144 ceph-mon[29535]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:40 smithi175 ceph-mon[34585]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:40.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:40 smithi154 ceph-mon[34710]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-05T07:51:42.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:42 smithi144 ceph-mon[29535]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:51:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:42 smithi175 ceph-mon[34585]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:51:42.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:42 smithi154 ceph-mon[34710]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:51:43.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:43 smithi144 ceph-mon[29535]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-09-05T07:51:43.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:43 smithi175 ceph-mon[34585]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-09-05T07:51:43.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:43 smithi154 ceph-mon[34710]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-09-05T07:51:46.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:46 smithi175 ceph-mon[34585]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:46 smithi154 ceph-mon[34710]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:46.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:46 smithi144 ceph-mon[29535]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:48.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:48 smithi175 ceph-mon[34585]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:48 smithi154 ceph-mon[34710]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:48 smithi144 ceph-mon[29535]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:51:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:50 smithi154 ceph-mon[34710]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:50 smithi144 ceph-mon[29535]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:50 smithi175 ceph-mon[34585]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 -- 172.21.15.144:0/2345554332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101f40 msgr2=0x7fbc30109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 --2- 172.21.15.144:0/2345554332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101f40 0x7fbc30109db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009ca0 tx=0x7fbc2802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 -- 172.21.15.144:0/2345554332 shutdown_connections 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 --2- 172.21.15.144:0/2345554332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30101580 0x7fbc30101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 --2- 172.21.15.144:0/2345554332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101f40 0x7fbc30109db0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 --2- 172.21.15.144:0/2345554332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30103050 0x7fbc30103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 -- 172.21.15.144:0/2345554332 >> 172.21.15.144:0/2345554332 conn(0x7fbc300fd0d0 msgr2=0x7fbc300ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 -- 172.21.15.144:0/2345554332 shutdown_connections 2024-09-05T07:51:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.302+0000 7fbc35a00640 1 -- 172.21.15.144:0/2345554332 wait complete. 2024-09-05T07:51:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 Processor -- start 2024-09-05T07:51:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 -- start start 2024-09-05T07:51:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30101f40 0x7fbc3019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 0x7fbc301a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d720 con 0x7fbc30101580 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d5a0 con 0x7fbc30103050 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc35a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d8a0 con 0x7fbc30101f40 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.303+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51624/0 (socket says 172.21.15.144:51624) 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 -- 172.21.15.144:0/1052266933 learned_addr learned my addr 172.21.15.144:0/1052266933 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc35000640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 0x7fbc301a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2f400640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30101f40 0x7fbc3019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 -- 172.21.15.144:0/1052266933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30101f40 msgr2=0x7fbc3019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30101f40 0x7fbc3019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 -- 172.21.15.144:0/1052266933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 msgr2=0x7fbc301a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 0x7fbc301a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 -- 172.21.15.144:0/1052266933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc301a1bd0 con 0x7fbc30101580 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc35000640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 0x7fbc301a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.304+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d950 tx=0x7fbc2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.305+0000 7fbc2cc00640 1 -- 172.21.15.144:0/1052266933 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20017020 con 0x7fbc30101580 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.305+0000 7fbc2cc00640 1 -- 172.21.15.144:0/1052266933 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc20009c30 con 0x7fbc30101580 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.305+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc301a1ec0 con 0x7fbc30101580 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.305+0000 7fbc2cc00640 1 -- 172.21.15.144:0/1052266933 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000f720 con 0x7fbc30101580 2024-09-05T07:51:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.305+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc301a2320 con 0x7fbc30101580 2024-09-05T07:51:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.308+0000 7fbc3a06a740 1 Processor -- start 2024-09-05T07:51:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 -- start start 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b13660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 0x55ca27b160f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca27a73100 con 0x55ca27b0e260 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca27a1b1b0 con 0x55ca27b13c30 2024-09-05T07:51:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca27a6f0c0 con 0x55ca27b0eba0 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc35000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc35000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51628/0 (socket says 172.21.15.144:51628) 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc35000640 1 -- 172.21.15.144:0/643825640 learned_addr learned my addr 172.21.15.144:0/643825640 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc2cc00640 1 -- 172.21.15.144:0/1052266933 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fbc2001a020 con 0x7fbc30101580 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.309+0000 7fbc2f400640 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 0x55ca27b160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 -- 172.21.15.144:0/643825640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 msgr2=0x55ca27b13660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b13660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 -- 172.21.15.144:0/643825640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 msgr2=0x55ca27b0e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 -- 172.21.15.144:0/643825640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca27786210 con 0x55ca27b13c30 2024-09-05T07:51:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc35000640 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc2f400640 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 0x55ca27b160f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009bf0 tx=0x7fbc1c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a29b4dbe7c4818 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc25600640 1 -- 172.21.15.144:0/643825640 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c004050 con 0x55ca27b13c30 2024-09-05T07:51:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc25600640 1 -- 172.21.15.144:0/643825640 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c005500 con 0x55ca27b13c30 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.310+0000 7fbc25600640 1 -- 172.21.15.144:0/643825640 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c004e40 con 0x55ca27b13c30 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc2cc00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 0x7fbc140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc2cc00640 1 -- 172.21.15.144:0/1052266933 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fbc200cf060 con 0x7fbc30101580 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 -- 172.21.15.144:0/643825640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 msgr2=0x55ca27b160f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 0x55ca27b160f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009bf0 tx=0x7fbc1c011810 comp rx=0 tx=0).stop 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc35000640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 0x7fbc140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 -- 172.21.15.144:0/643825640 shutdown_connections 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b13c30 0x55ca27b160f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b13660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/643825640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0e260 0x55ca27b0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 -- 172.21.15.144:0/643825640 >> 172.21.15.144:0/643825640 conn(0x55ca27b098d0 msgr2=0x55ca27b09cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 -- 172.21.15.144:0/643825640 shutdown_connections 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.311+0000 7fbc3a06a740 1 -- 172.21.15.144:0/643825640 wait complete. 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 -- start start 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc35000640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 0x7fbc140a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802ade0 tx=0x7fbc28031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 Processor -- start 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b18950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 0x55ca27b1f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca27b16c00 con 0x55ca27b0eba0 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca279fc090 con 0x55ca27b0e260 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.312+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca27b16d80 con 0x55ca27b13c30 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc3a06a740 10 client.0 _ll_register_callbacks cb 0x55ca27a50f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc35000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 0x55ca27b1f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b18950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:35282/0 (socket says 172.21.15.144:35282) 2024-09-05T07:51:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 -- 172.21.15.144:0/2151160271 learned_addr learned my addr 172.21.15.144:0/2151160271 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc35000640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 0x55ca27b1f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:38688/0 (socket says 172.21.15.144:38688) 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 -- 172.21.15.144:0/2151160271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 msgr2=0x55ca27b1f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 0x55ca27b1f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 -- 172.21.15.144:0/2151160271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 msgr2=0x55ca27b18950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b18950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 -- 172.21.15.144:0/2151160271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca27852620 con 0x55ca27b0e260 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc2009b320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b64a8018d1c46b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.313+0000 7fbc1a000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:51:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2009b6f0 con 0x55ca27b0e260 2024-09-05T07:51:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fbc20097d60 con 0x55ca27b0e260 2024-09-05T07:51:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc1c005500 con 0x55ca27b0e260 2024-09-05T07:51:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc2009faa0 con 0x55ca27b0e260 2024-09-05T07:51:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 10 client.25160 fetch_fsmap learned FSMap version 29 2024-09-05T07:51:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ca27b227f0 con 0x55ca27b0e260 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c005500 con 0x55ca27b0e260 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc2009ab40 con 0x55ca27b0e260 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 10 client.25160 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 10 client.25160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.314+0000 7fbc3a06a740 20 client.25160 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b23de0 0x55ca27b261d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc3a06a740 4 client.25160 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca27a80830 con 0x55ca27b23de0 2024-09-05T07:51:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc2f400640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b23de0 0x55ca27b261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc2f400640 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b23de0 0x55ca27b261d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25a6631d06fe497 server_cookie=25af233c03a88d4c in_seq=0 out_seq=0 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.315+0000 7fbc1a000640 10 client.25160 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.316+0000 7fbc1a000640 1 -- 172.21.15.144:0/2151160271 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca27a80830 con 0x55ca27b23de0 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.316+0000 7fbc1a000640 10 client.25160 handle_command_reply: tid=0 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.316+0000 7fbc3a06a740 1 client.25160 shutdown 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 msgr2=0x55ca27b18410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc2009b320 comp rx=0 tx=0).stop 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 shutdown_connections 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b23de0 0x55ca27b261d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b13c30 0x55ca27b1f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc1a000640 0 client.25160 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b18950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2151160271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b18410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 >> 172.21.15.144:0/2151160271 conn(0x55ca27b098d0 msgr2=0x55ca27b0b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 shutdown_connections 2024-09-05T07:51:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2151160271 wait complete. 2024-09-05T07:51:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.317+0000 7fbc3a06a740 20 client.25160 trim_cache size 0 max 16384 2024-09-05T07:51:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 Processor -- start 2024-09-05T07:51:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 -- start start 2024-09-05T07:51:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301ab110 con 0x55ca27b0eba0 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301acc50 con 0x55ca27b0e260 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301ab7e0 con 0x55ca27b098d0 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc2f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc35000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.346+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:38698/0 (socket says 172.21.15.144:38698) 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 -- 172.21.15.144:0/275904532 learned_addr learned my addr 172.21.15.144:0/275904532 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 -- 172.21.15.144:0/275904532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 msgr2=0x55ca27b1f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 -- 172.21.15.144:0/275904532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 msgr2=0x55ca27b2aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b2aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 -- 172.21.15.144:0/275904532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca27b26800 con 0x55ca27b098d0 2024-09-05T07:51:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc2009b680 tx=0x7fbc20010da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1205d57331e9e061 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc24c00640 1 -- 172.21.15.144:0/275904532 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2009b6f0 con 0x55ca27b098d0 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc24c00640 1 -- 172.21.15.144:0/275904532 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc200d1110 con 0x55ca27b098d0 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.347+0000 7fbc24c00640 1 -- 172.21.15.144:0/275904532 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ccbf0 con 0x55ca27b098d0 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 -- 172.21.15.144:0/275904532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 msgr2=0x55ca27b18830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc2009b680 tx=0x7fbc20010da0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 -- 172.21.15.144:0/275904532 shutdown_connections 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b0eba0 0x55ca27b2aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/275904532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b098d0 0x55ca27b18830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 -- 172.21.15.144:0/275904532 >> 172.21.15.144:0/275904532 conn(0x55ca27b0f660 msgr2=0x55ca27b0afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 -- 172.21.15.144:0/275904532 shutdown_connections 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.348+0000 7fbc3a06a740 1 -- 172.21.15.144:0/275904532 wait complete. 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 -- start start 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 Processor -- start 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b1ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301ac580 con 0x55ca27b098d0 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301abeb0 con 0x55ca27b0e260 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301a90f0 con 0x55ca27b0eba0 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc3a06a740 10 client.0 _ll_register_callbacks cb 0x7fbc2009b530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51644/0 (socket says 172.21.15.144:51644) 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc2fe00640 1 -- 172.21.15.144:0/2761060986 learned_addr learned my addr 172.21.15.144:0/2761060986 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc35000640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b1ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.349+0000 7fbc2f400640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 -- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 msgr2=0x55ca27b1da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 -- 172.21.15.144:0/2761060986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 msgr2=0x55ca27b1d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 -- 172.21.15.144:0/2761060986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca27b1f040 con 0x55ca27b0eba0 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc2f400640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc35000640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b1ea30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc28031ae0 tx=0x7fbc2802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b85a338df2775b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc1a000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:51:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28003e60 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc200d1110 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.350+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fbc28043030 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc28004250 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 10 client.25171 fetch_fsmap learned FSMap version 29 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ca27b8ef90 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc200d1110 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc2805f050 con 0x55ca27b0eba0 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 10 client.25171 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 10 client.25171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 20 client.25171 populate_metadata read hostname 'smithi144' 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b13c30 0x55ca27b91900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 4 client.25171 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:51:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca27a7ab80 con 0x55ca27b13c30 2024-09-05T07:51:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.351+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b13c30 0x55ca27b91900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:51:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.352+0000 7fbc1a000640 10 client.25171 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.352+0000 7fbc2fe00640 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b13c30 0x55ca27b91900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2fa5afbd8f0059f server_cookie=ca3648643abf78d0 in_seq=0 out_seq=0 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc1a000640 1 -- 172.21.15.144:0/2761060986 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca27a7ab80 con 0x55ca27b13c30 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc1a000640 10 client.25171 handle_command_reply: tid=0 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 client.25171 shutdown 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 msgr2=0x55ca27b1ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b1ea30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc28031ae0 tx=0x7fbc2802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 shutdown_connections 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ca27b13c30 0x55ca27b91900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca27b0e260 0x55ca27b1da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca27b0eba0 0x55ca27b1ea30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc1a000640 0 client.25171 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 --2- 172.21.15.144:0/2761060986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca27b098d0 0x55ca27b1d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 >> 172.21.15.144:0/2761060986 conn(0x55ca27b0f660 msgr2=0x55ca27b0afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 shutdown_connections 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 1 -- 172.21.15.144:0/2761060986 wait complete. 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.358+0000 7fbc3a06a740 20 client.25171 trim_cache size 0 max 16384 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:51:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 msgr2=0x7fbc140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 0x7fbc140a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802ade0 tx=0x7fbc28031bb0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 msgr2=0x7fbc30199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d950 tx=0x7fbc2000de10 comp rx=0 tx=0).stop 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 shutdown_connections 2024-09-05T07:51:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fbc140a2c10 0x7fbc140a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc30103050 0x7fbc301a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc30101f40 0x7fbc3019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 --2- 172.21.15.144:0/1052266933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30101580 0x7fbc30199fb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 >> 172.21.15.144:0/1052266933 conn(0x7fbc300fd0d0 msgr2=0x7fbc30074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 shutdown_connections 2024-09-05T07:51:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:51:52.359+0000 7fbc35a00640 1 -- 172.21.15.144:0/1052266933 wait complete. 2024-09-05T07:51:52.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:52 smithi154 ceph-mon[34710]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-05T07:51:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:52 smithi144 ceph-mon[29535]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-05T07:51:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:52 smithi175 ceph-mon[34585]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-05T07:51:54.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:54 smithi154 ceph-mon[34710]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:54 smithi144 ceph-mon[29535]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:54 smithi175 ceph-mon[34585]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-05T07:51:56.624 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:56 smithi144 ceph-mon[29535]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:56 smithi154 ceph-mon[34710]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:56 smithi175 ceph-mon[34585]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:58.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:51:58 smithi154 ceph-mon[34710]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:51:58 smithi144 ceph-mon[29535]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:51:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:51:58 smithi175 ceph-mon[34585]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:52:00.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:00 smithi154 ceph-mon[34710]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-05T07:52:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:00 smithi144 ceph-mon[29535]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-05T07:52:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:00 smithi175 ceph-mon[34585]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-05T07:52:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:02 smithi154 ceph-mon[34710]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:52:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:02 smithi144 ceph-mon[29535]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:52:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:02 smithi175 ceph-mon[34585]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-05T07:52:04.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:04 smithi154 ceph-mon[34710]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T07:52:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:04 smithi144 ceph-mon[29535]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T07:52:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:04 smithi175 ceph-mon[34585]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 -- 172.21.15.144:0/3180073540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 msgr2=0x7fd13410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 --2- 172.21.15.144:0/3180073540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd13410bfb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009be0 tx=0x7fd12c02a6c0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 -- 172.21.15.144:0/3180073540 shutdown_connections 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 --2- 172.21.15.144:0/3180073540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134104d60 0x7fd1341051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 --2- 172.21.15.144:0/3180073540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd13410bfb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 --2- 172.21.15.144:0/3180073540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134103b70 0x7fd134103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 -- 172.21.15.144:0/3180073540 >> 172.21.15.144:0/3180073540 conn(0x7fd1340ff2f0 msgr2=0x7fd134101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 -- 172.21.15.144:0/3180073540 shutdown_connections 2024-09-05T07:52:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.479+0000 7fd139600640 1 -- 172.21.15.144:0/3180073540 wait complete. 2024-09-05T07:52:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.480+0000 7fd139600640 1 Processor -- start 2024-09-05T07:52:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.480+0000 7fd139600640 1 -- start start 2024-09-05T07:52:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 0x7fd134199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd1341a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410f780 con 0x7fd134104d60 2024-09-05T07:52:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410f600 con 0x7fd134103b70 2024-09-05T07:52:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd139600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410f900 con 0x7fd134105720 2024-09-05T07:52:05.482 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd133400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd133400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44628/0 (socket says 172.21.15.144:44628) 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.481+0000 7fd133400640 1 -- 172.21.15.144:0/1087405480 learned_addr learned my addr 172.21.15.144:0/1087405480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 0x7fd134199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd138c00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd1341a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 -- 172.21.15.144:0/1087405480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 msgr2=0x7fd1341a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd1341a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 -- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 msgr2=0x7fd13419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133e00640 1 -- 172.21.15.144:0/1087405480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341a1a20 con 0x7fd134103b70 2024-09-05T07:52:05.483 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.482+0000 7fd133400640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd133e00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 0x7fd134199e00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd134104bc0 tx=0x7fd12400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd130c00640 1 -- 172.21.15.144:0/1087405480 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124004440 con 0x7fd134103b70 2024-09-05T07:52:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd130c00640 1 -- 172.21.15.144:0/1087405480 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd12400cda0 con 0x7fd134103b70 2024-09-05T07:52:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd130c00640 1 -- 172.21.15.144:0/1087405480 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240196e0 con 0x7fd134103b70 2024-09-05T07:52:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341a1d10 con 0x7fd134103b70 2024-09-05T07:52:05.485 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.483+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341a21b0 con 0x7fd134103b70 2024-09-05T07:52:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 Processor -- start 2024-09-05T07:52:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 -- start start 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7ca70 0x55dc57c7ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 0x55dc57c81e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c84900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dc57bd9100 con 0x55dc57c7d3b0 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc57b811b0 con 0x55dc57c82440 2024-09-05T07:52:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.488+0000 7fd13da5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc57bd50c0 con 0x55dc57c7ca70 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd130c00640 1 -- 172.21.15.144:0/1087405480 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fd124003780 con 0x7fd134103b70 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd138c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7ca70 0x55dc57c7ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c84900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c84900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43724/0 (socket says 172.21.15.144:43724) 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd133400640 1 -- 172.21.15.144:0/1412005333 learned_addr learned my addr 172.21.15.144:0/1412005333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.489+0000 7fd133e00640 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 0x55dc57c81e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.490+0000 7fd133e00640 1 -- 172.21.15.144:0/1412005333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7ca70 msgr2=0x55dc57c7ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.490+0000 7fd133e00640 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7ca70 0x55dc57c7ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.490+0000 7fd133e00640 1 -- 172.21.15.144:0/1412005333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 msgr2=0x55dc57c84900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.490+0000 7fd133e00640 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c84900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.490+0000 7fd133e00640 1 -- 172.21.15.144:0/1412005333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc578ec210 con 0x55dc57c7d3b0 2024-09-05T07:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.491+0000 7fd133e00640 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 0x55dc57c81e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd1240cce90 tx=0x7fd1240d5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb84736cfb5df8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.491+0000 7fd129200640 1 -- 172.21.15.144:0/1412005333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240e3070 con 0x55dc57c7d3b0 2024-09-05T07:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.492+0000 7fd129200640 1 -- 172.21.15.144:0/1412005333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1240cfe40 con 0x55dc57c7d3b0 2024-09-05T07:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.492+0000 7fd129200640 1 -- 172.21.15.144:0/1412005333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240db9a0 con 0x55dc57c7d3b0 2024-09-05T07:52:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.492+0000 7fd130c00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.492+0000 7fd130c00640 1 -- 172.21.15.144:0/1087405480 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fd1240cf4f0 con 0x7fd134103b70 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 -- 172.21.15.144:0/1412005333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 msgr2=0x55dc57c81e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 0x55dc57c81e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd1240cce90 tx=0x7fd1240d5790 comp rx=0 tx=0).stop 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd138c00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 -- 172.21.15.144:0/1412005333 shutdown_connections 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c84900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7d3b0 0x55dc57c81e70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 --2- 172.21.15.144:0/1412005333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7ca70 0x55dc57c7ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 -- 172.21.15.144:0/1412005333 >> 172.21.15.144:0/1412005333 conn(0x55dc57c6f8d0 msgr2=0x55dc57c6fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.493+0000 7fd13da5e740 1 -- 172.21.15.144:0/1412005333 shutdown_connections 2024-09-05T07:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.494+0000 7fd13da5e740 1 -- 172.21.15.144:0/1412005333 wait complete. 2024-09-05T07:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.494+0000 7fd138c00640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 0x7fd1180a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004ad0 tx=0x7fd12c004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 -- start start 2024-09-05T07:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 Processor -- start 2024-09-05T07:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c86ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dc57c85410 con 0x55dc57c7ca70 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.495+0000 7fd13da5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc57b62090 con 0x55dc57c7d3b0 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd13da5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc57c85590 con 0x55dc57c82440 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd13da5e740 10 client.0 _ll_register_callbacks cb 0x55dc57bb6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c86ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43732/0 (socket says 172.21.15.144:43732) 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 -- 172.21.15.144:0/56944749 learned_addr learned my addr 172.21.15.144:0/56944749 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd138c00640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 -- 172.21.15.144:0/56944749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 msgr2=0x55dc57c8e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 -- 172.21.15.144:0/56944749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 msgr2=0x55dc57c86ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c86ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd133400640 1 -- 172.21.15.144:0/56944749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc579b8620 con 0x55dc57c7d3b0 2024-09-05T07:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.496+0000 7fd138c00640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.497+0000 7fd133400640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd120012d20 tx=0x7fd12000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d378b47665403729 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.497+0000 7fd11d600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.497+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120010430 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.497+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc57be6830 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.497+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fd1200105d0 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd1200107d0 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 10 client.25178 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dc57c91170 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55dc57be6830 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd120025050 con 0x55dc57c7d3b0 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 10 client.25178 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 10 client.25178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 20 client.25178 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57c927a0 0x55dc57c94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 4 client.25178 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:52:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.498+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc57be0b80 con 0x55dc57c927a0 2024-09-05T07:52:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.499+0000 7fd133e00640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57c927a0 0x55dc57c94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.499+0000 7fd133e00640 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57c927a0 0x55dc57c94bf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8b23c9e98c8a8c server_cookie=9c83cdf730819c22 in_seq=0 out_seq=0 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.499+0000 7fd11d600640 10 client.25178 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd11d600640 1 -- 172.21.15.144:0/56944749 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc57be0b80 con 0x55dc57c927a0 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd11d600640 10 client.25178 handle_command_reply: tid=0 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 client.25178 shutdown 2024-09-05T07:52:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 msgr2=0x55dc57c87220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd120012d20 tx=0x7fd12000f790 comp rx=0 tx=0).stop 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 shutdown_connections 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57c927a0 0x55dc57c94bf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd11d600640 0 client.25178 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c87220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 --2- 172.21.15.144:0/56944749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c86ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.500+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 >> 172.21.15.144:0/56944749 conn(0x55dc57c6f8d0 msgr2=0x55dc57c710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.501+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 shutdown_connections 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.501+0000 7fd13da5e740 1 -- 172.21.15.144:0/56944749 wait complete. 2024-09-05T07:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.501+0000 7fd13da5e740 20 client.25178 trim_cache size 0 max 16384 2024-09-05T07:52:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 Processor -- start 2024-09-05T07:52:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 -- start start 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c6ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a6c90 con 0x55dc57c7ca70 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a87d0 con 0x55dc57c7d3b0 2024-09-05T07:52:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.529+0000 7fd13da5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a7360 con 0x55dc57c82440 2024-09-05T07:52:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44670/0 (socket says 172.21.15.144:44670) 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 -- 172.21.15.144:0/3897584584 learned_addr learned my addr 172.21.15.144:0/3897584584 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133400640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c6ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd138c00640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 -- 172.21.15.144:0/3897584584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 msgr2=0x55dc57c8e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 -- 172.21.15.144:0/3897584584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 msgr2=0x55dc57c6ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c6ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.530+0000 7fd133e00640 1 -- 172.21.15.144:0/3897584584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc57c6f6f0 con 0x55dc57c7ca70 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.531+0000 7fd133400640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c6ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.531+0000 7fd133e00640 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd124098040 tx=0x7fd1240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c123956309be2e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.531+0000 7fd11fe00640 1 -- 172.21.15.144:0/3897584584 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124086040 con 0x55dc57c7ca70 2024-09-05T07:52:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.531+0000 7fd11fe00640 1 -- 172.21.15.144:0/3897584584 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1240d2e00 con 0x55dc57c7ca70 2024-09-05T07:52:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.531+0000 7fd11fe00640 1 -- 172.21.15.144:0/3897584584 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12409c2e0 con 0x55dc57c7ca70 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 -- 172.21.15.144:0/3897584584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 msgr2=0x55dc57c6e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd124098040 tx=0x7fd1240045e0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 -- 172.21.15.144:0/3897584584 shutdown_connections 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c7d3b0 0x55dc57c6ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c82440 0x55dc57c8e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 --2- 172.21.15.144:0/3897584584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c7ca70 0x55dc57c6e900 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 -- 172.21.15.144:0/3897584584 >> 172.21.15.144:0/3897584584 conn(0x55dc57c6f8d0 msgr2=0x55dc57c6e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 -- 172.21.15.144:0/3897584584 shutdown_connections 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.532+0000 7fd13da5e740 1 -- 172.21.15.144:0/3897584584 wait complete. 2024-09-05T07:52:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 -- start start 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 Processor -- start 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 0x55dc57c8b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c927a0 0x55dc57c8ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a8100 con 0x55dc57c927a0 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a7a30 con 0x55dc57c82440 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341a4c70 con 0x55dc57c7d3b0 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.533+0000 7fd13da5e740 10 client.0 _ll_register_callbacks cb 0x7fd120009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 0x55dc57c8b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43760/0 (socket says 172.21.15.144:43760) 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 -- 172.21.15.144:0/2016911246 learned_addr learned my addr 172.21.15.144:0/2016911246 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133e00640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 0x55dc57c8b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:51144/0 (socket says 172.21.15.144:51144) 2024-09-05T07:52:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd138c00640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c927a0 0x55dc57c8ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 -- 172.21.15.144:0/2016911246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 msgr2=0x55dc57c8b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 0x55dc57c8b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 -- 172.21.15.144:0/2016911246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c927a0 msgr2=0x55dc57c8ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c927a0 0x55dc57c8ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.534+0000 7fd133400640 1 -- 172.21.15.144:0/2016911246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc57c8d010 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd133400640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd120005d00 tx=0x7fd12000fd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320b07441be89c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd11d600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12001c630 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fd120018040 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1240d2e00 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd12001c7d0 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd13da5e740 10 client.25184 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.535+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dc57c8e390 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1240d2e00 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd120025070 con 0x55dc57c82440 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 10 client.25184 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 10 client.25184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 20 client.25184 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57cfdad0 0x55dc57cffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 4 client.25184 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.536+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc57b5d7c0 con 0x55dc57cfdad0 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.537+0000 7fd133e00640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57cfdad0 0x55dc57cffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.537+0000 7fd133e00640 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57cfdad0 0x55dc57cffef0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbc169b2bf01f486 server_cookie=ceceb0048bd4936c in_seq=0 out_seq=0 2024-09-05T07:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.537+0000 7fd11d600640 10 client.25184 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.545+0000 7fd11d600640 1 -- 172.21.15.144:0/2016911246 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc57b5d7c0 con 0x55dc57cfdad0 2024-09-05T07:52:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.545+0000 7fd11d600640 10 client.25184 handle_command_reply: tid=0 2024-09-05T07:52:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.545+0000 7fd13da5e740 1 client.25184 shutdown 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.545+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 msgr2=0x55dc57c8b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd120005d00 tx=0x7fd12000fd10 comp rx=0 tx=0).stop 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 shutdown_connections 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55dc57cfdad0 0x55dc57cffef0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc57c82440 0x55dc57c8b9f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc57c927a0 0x55dc57c8ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 --2- 172.21.15.144:0/2016911246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc57c7d3b0 0x55dc57c8b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd11d600640 0 client.25184 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 >> 172.21.15.144:0/2016911246 conn(0x55dc57c6f8d0 msgr2=0x55dc57c6ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 shutdown_connections 2024-09-05T07:52:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 1 -- 172.21.15.144:0/2016911246 wait complete. 2024-09-05T07:52:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.546+0000 7fd13da5e740 20 client.25184 trim_cache size 0 max 16384 2024-09-05T07:52:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:52:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:52:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:52:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 msgr2=0x7fd1180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 0x7fd1180a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004ad0 tx=0x7fd12c004a60 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 msgr2=0x7fd134199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 0x7fd134199e00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd134104bc0 tx=0x7fd12400ee50 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 shutdown_connections 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd1180a2c90 0x7fd1180a5150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd134105720 0x7fd1341a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd134104d60 0x7fd13419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 --2- 172.21.15.144:0/1087405480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd134103b70 0x7fd134199e00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 >> 172.21.15.144:0/1087405480 conn(0x7fd1340ff2f0 msgr2=0x7fd134108080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.547+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 shutdown_connections 2024-09-05T07:52:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:05.548+0000 7fd139600640 1 -- 172.21.15.144:0/1087405480 wait complete. 2024-09-05T07:52:06.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:06 smithi154 ceph-mon[34710]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-05T07:52:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:06 smithi144 ceph-mon[29535]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-05T07:52:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:06 smithi175 ceph-mon[34585]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-05T07:52:08.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:08 smithi154 ceph-mon[34710]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:52:08.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:08 smithi144 ceph-mon[29535]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:52:08.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:08 smithi175 ceph-mon[34585]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-05T07:52:10.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:10 smithi154 ceph-mon[34710]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:10.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:10 smithi144 ceph-mon[29535]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:10 smithi175 ceph-mon[34585]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:12 smithi154 ceph-mon[34710]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T07:52:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:12 smithi144 ceph-mon[29535]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T07:52:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:12 smithi175 ceph-mon[34585]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-05T07:52:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:14 smithi154 ceph-mon[34710]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:14 smithi144 ceph-mon[29535]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:14 smithi175 ceph-mon[34585]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-05T07:52:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:16 smithi175 ceph-mon[34585]: pgmap v380: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:16 smithi154 ceph-mon[34710]: pgmap v380: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:16 smithi144 ceph-mon[29535]: pgmap v380: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:18.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:18 smithi154 ceph-mon[34710]: pgmap v381: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 -- 172.21.15.144:0/1461556720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 msgr2=0x7fefe010bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 --2- 172.21.15.144:0/1461556720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe010bfb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009ca0 tx=0x7fefd802a8c0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 -- 172.21.15.144:0/1461556720 shutdown_connections 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 --2- 172.21.15.144:0/1461556720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe010bfb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 --2- 172.21.15.144:0/1461556720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 0x7fefe01051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 --2- 172.21.15.144:0/1461556720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 -- 172.21.15.144:0/1461556720 >> 172.21.15.144:0/1461556720 conn(0x7fefe00ff2f0 msgr2=0x7fefe0101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 -- 172.21.15.144:0/1461556720 shutdown_connections 2024-09-05T07:52:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.706+0000 7fefe4c00640 1 -- 172.21.15.144:0/1461556720 wait complete. 2024-09-05T07:52:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.707+0000 7fefe4c00640 1 Processor -- start 2024-09-05T07:52:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.707+0000 7fefe4c00640 1 -- start start 2024-09-05T07:52:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 0x7fefe019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe01a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010f820 con 0x7fefe0104d60 2024-09-05T07:52:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010f6a0 con 0x7fefe0103b70 2024-09-05T07:52:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefe4c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fefe010f9a0 con 0x7fefe0105720 2024-09-05T07:52:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefdf400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefdf400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:47718/0 (socket says 172.21.15.144:47718) 2024-09-05T07:52:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefdf400640 1 -- 172.21.15.144:0/3744012014 learned_addr learned my addr 172.21.15.144:0/3744012014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefdea00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 0x7fefe019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.708+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe01a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 -- 172.21.15.144:0/3744012014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 msgr2=0x7fefe01a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe01a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 -- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 msgr2=0x7fefe019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 0x7fefe019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 -- 172.21.15.144:0/3744012014 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe01a1a10 con 0x7fefe0103b70 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefdf400640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9c0 tx=0x7fefd000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.709+0000 7fefd7e00640 1 -- 172.21.15.144:0/3744012014 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000cd80 con 0x7fefe0103b70 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.710+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe01a1d00 con 0x7fefe0103b70 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.710+0000 7fefd7e00640 1 -- 172.21.15.144:0/3744012014 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd00035f0 con 0x7fefe0103b70 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.710+0000 7fefd7e00640 1 -- 172.21.15.144:0/3744012014 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0010690 con 0x7fefe0103b70 2024-09-05T07:52:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.710+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe01a21a0 con 0x7fefe0103b70 2024-09-05T07:52:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.714+0000 7fefe909f740 1 Processor -- start 2024-09-05T07:52:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.714+0000 7fefe909f740 1 -- start start 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dc0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dc5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefd7e00640 1 -- 172.21.15.144:0/3744012014 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fefd00037a0 con 0x7fefe0103b70 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dc80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d25100 con 0x5642d8dc5c30 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642d8ccd1b0 con 0x5642d8dc0260 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefe909f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d210c0 con 0x5642d8dc0ba0 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dc0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefdea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dc80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefdea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dc80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52990/0 (socket says 172.21.15.144:52990) 2024-09-05T07:52:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefdea00640 1 -- 172.21.15.144:0/3445533748 learned_addr learned my addr 172.21.15.144:0/3445533748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.715+0000 7fefdf400640 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dc5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 -- 172.21.15.144:0/3445533748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 msgr2=0x5642d8dc5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dc5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 -- 172.21.15.144:0/3445533748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 msgr2=0x5642d8dc80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dc80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 -- 172.21.15.144:0/3445533748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d8a38210 con 0x5642d8dc0260 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdf400640 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dc5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dc0660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefd802ade0 tx=0x7fefd80093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f44a442b1e5d8225 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.716+0000 7fefcbe00640 1 -- 172.21.15.144:0/3445533748 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8031650 con 0x5642d8dc0260 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.717+0000 7fefcbe00640 1 -- 172.21.15.144:0/3445533748 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8036030 con 0x5642d8dc0260 2024-09-05T07:52:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.717+0000 7fefcbe00640 1 -- 172.21.15.144:0/3445533748 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80046e0 con 0x5642d8dc0260 2024-09-05T07:52:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.717+0000 7fefd7e00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 0x7fefc40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.717+0000 7fefe909f740 1 -- 172.21.15.144:0/3445533748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 msgr2=0x5642d8dc0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.717+0000 7fefe909f740 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dc0660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefd802ade0 tx=0x7fefd80093c0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefd7e00640 1 -- 172.21.15.144:0/3744012014 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fefd00cf620 con 0x7fefe0103b70 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 -- 172.21.15.144:0/3445533748 shutdown_connections 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dc80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dc5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 --2- 172.21.15.144:0/3445533748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dc0660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 -- 172.21.15.144:0/3445533748 >> 172.21.15.144:0/3445533748 conn(0x5642d8dbb8d0 msgr2=0x5642d8dbbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefdf400640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 0x7fefc40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.718+0000 7fefe909f740 1 -- 172.21.15.144:0/3445533748 shutdown_connections 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.719+0000 7fefe909f740 1 -- 172.21.15.144:0/3445533748 wait complete. 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.719+0000 7fefdf400640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 0x7fefc40a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd0098110 tx=0x7fefd0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.719+0000 7fefe909f740 1 -- start start 2024-09-05T07:52:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.719+0000 7fefe909f740 1 Processor -- start 2024-09-05T07:52:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5642d8dc8a20 con 0x5642d8dc5c30 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642d8cae090 con 0x5642d8dc0ba0 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5642d8dc8ba0 con 0x5642d8dc0260 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefe909f740 10 client.0 _ll_register_callbacks cb 0x5642d8d02f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:47440/0 (socket says 172.21.15.144:47440) 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.720+0000 7fefdfe00640 1 -- 172.21.15.144:0/572997516 learned_addr learned my addr 172.21.15.144:0/572997516 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdea00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 -- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 msgr2=0x5642d8dca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 -- 172.21.15.144:0/572997516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 msgr2=0x5642d8dd1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 -- 172.21.15.144:0/572997516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d8b04620 con 0x5642d8dc0260 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefdfe00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefd802b0b0 tx=0x7fefd802b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e4ee25dc0a500eb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8003b70 con 0x5642d8dc0260 2024-09-05T07:52:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefd8036030 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.721+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fefd8003d10 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.722+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefd802f610 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.722+0000 7fefe909f740 10 client.25201 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.722+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5642d8dc8a20 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.722+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8036030 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefd8050070 con 0x5642d8dc0260 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 10 client.25201 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 10 client.25201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 20 client.25201 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8dd5a50 0x5642d8dd7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 4 client.25201 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642d8d32830 con 0x5642d8dd5a50 2024-09-05T07:52:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.723+0000 7fefdea00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8dd5a50 0x5642d8dd7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.724+0000 7fefdea00640 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8dd5a50 0x5642d8dd7e70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a473c172c635c8 server_cookie=ae87e0d47b567b24 in_seq=0 out_seq=0 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.724+0000 7fefc8c00640 10 client.25201 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.724+0000 7fefc8c00640 1 -- 172.21.15.144:0/572997516 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642d8d32830 con 0x5642d8dd5a50 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.724+0000 7fefc8c00640 10 client.25201 handle_command_reply: tid=0 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 client.25201 shutdown 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 msgr2=0x5642d8dca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefd802b0b0 tx=0x7fefd802b040 comp rx=0 tx=0).stop 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 shutdown_connections 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8dd5a50 0x5642d8dd7e70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 --2- 172.21.15.144:0/572997516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0260 0x5642d8dca290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefc8c00640 0 client.25201 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 >> 172.21.15.144:0/572997516 conn(0x5642d8dbb8d0 msgr2=0x5642d8dbd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 shutdown_connections 2024-09-05T07:52:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 1 -- 172.21.15.144:0/572997516 wait complete. 2024-09-05T07:52:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.725+0000 7fefe909f740 20 client.25201 trim_cache size 0 max 16384 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.740+0000 7fefe909f740 1 Processor -- start 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.740+0000 7fefe909f740 1 -- start start 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dd1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc5c30 0x5642d8dba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01aaf10 con 0x5642d8dc0260 2024-09-05T07:52:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01aca50 con 0x5642d8dc0ba0 2024-09-05T07:52:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefe909f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01ab5e0 con 0x5642d8dc5c30 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53016/0 (socket says 172.21.15.144:53016) 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 -- 172.21.15.144:0/4162958012 learned_addr learned my addr 172.21.15.144:0/4162958012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdea00640 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dd1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc5c30 0x5642d8dba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 -- 172.21.15.144:0/4162958012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc5c30 msgr2=0x5642d8dba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc5c30 0x5642d8dba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 -- 172.21.15.144:0/4162958012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 msgr2=0x5642d8dd1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dd1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.741+0000 7fefdfe00640 1 -- 172.21.15.144:0/4162958012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d8dbb6f0 con 0x5642d8dc0260 2024-09-05T07:52:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.742+0000 7fefdfe00640 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fefd8006010 tx=0x7fefd8031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc5d1600956f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.742+0000 7fefcb400640 1 -- 172.21.15.144:0/4162958012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8063040 con 0x5642d8dc0260 2024-09-05T07:52:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.742+0000 7fefcb400640 1 -- 172.21.15.144:0/4162958012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8036070 con 0x5642d8dc0260 2024-09-05T07:52:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.742+0000 7fefcb400640 1 -- 172.21.15.144:0/4162958012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8030a20 con 0x5642d8dc0260 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 -- 172.21.15.144:0/4162958012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 msgr2=0x5642d8dba1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fefd8006010 tx=0x7fefd8031bb0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 -- 172.21.15.144:0/4162958012 shutdown_connections 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0ba0 0x5642d8dd1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc5c30 0x5642d8dba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 --2- 172.21.15.144:0/4162958012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc0260 0x5642d8dba1f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 -- 172.21.15.144:0/4162958012 >> 172.21.15.144:0/4162958012 conn(0x5642d8dbb8d0 msgr2=0x5642d8dca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 -- 172.21.15.144:0/4162958012 shutdown_connections 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.743+0000 7fefe909f740 1 -- 172.21.15.144:0/4162958012 wait complete. 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.744+0000 7fefe909f740 1 -- start start 2024-09-05T07:52:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.744+0000 7fefe909f740 1 Processor -- start 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dcedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dcf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01ac380 con 0x5642d8dc5c30 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01abcb0 con 0x5642d8dc0260 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01a8ef0 con 0x5642d8dc0ba0 2024-09-05T07:52:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefe909f740 10 client.0 _ll_register_callbacks cb 0x7fefcc0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53022/0 (socket says 172.21.15.144:53022) 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefdfe00640 1 -- 172.21.15.144:0/3548540087 learned_addr learned my addr 172.21.15.144:0/3548540087 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.745+0000 7fefdea00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dcf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 -- 172.21.15.144:0/3548540087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 msgr2=0x5642d8dcf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dcf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 -- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 msgr2=0x5642d8dcedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dcedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 -- 172.21.15.144:0/3548540087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d8dd0910 con 0x5642d8dc5c30 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdea00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dcf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefdfe00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005bd0 tx=0x7fefd8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3210cbbf111e58dd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.746+0000 7fefc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:52:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8004d40 con 0x5642d8dc5c30 2024-09-05T07:52:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fefd8003970 con 0x5642d8dc5c30 2024-09-05T07:52:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefd8036070 con 0x5642d8dc5c30 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefd80305c0 con 0x5642d8dc5c30 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefe909f740 10 client.15207 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5642d8dd1c20 con 0x5642d8dc5c30 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.747+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8036070 con 0x5642d8dc5c30 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefd8050040 con 0x5642d8dc5c30 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 10 client.15207 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 10 client.15207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 20 client.15207 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8e40dd0 0x5642d8e431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 4 client.15207 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5642d8d2cb80 con 0x5642d8e40dd0 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.748+0000 7fefdea00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8e40dd0 0x5642d8e431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.749+0000 7fefc8c00640 10 client.15207 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.749+0000 7fefdea00640 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8e40dd0 0x5642d8e431c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=188bd133a4786fdd server_cookie=eae2e812825c4feb in_seq=0 out_seq=0 2024-09-05T07:52:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.752+0000 7fefc8c00640 1 -- 172.21.15.144:0/3548540087 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5642d8d2cb80 con 0x5642d8e40dd0 2024-09-05T07:52:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.752+0000 7fefc8c00640 10 client.15207 handle_command_reply: tid=0 2024-09-05T07:52:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.752+0000 7fefe909f740 1 client.15207 shutdown 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 msgr2=0x5642d8dd0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005bd0 tx=0x7fefd8005dc0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 shutdown_connections 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x5642d8e40dd0 0x5642d8e431c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5642d8dc5c30 0x5642d8dd0300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642d8dc0ba0 0x5642d8dcf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 --2- 172.21.15.144:0/3548540087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642d8dc0260 0x5642d8dcedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 >> 172.21.15.144:0/3548540087 conn(0x5642d8dbb8d0 msgr2=0x5642d8dca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefc8c00640 0 client.15207 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 shutdown_connections 2024-09-05T07:52:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 1 -- 172.21.15.144:0/3548540087 wait complete. 2024-09-05T07:52:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.753+0000 7fefe909f740 20 client.15207 trim_cache size 0 max 16384 2024-09-05T07:52:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:52:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:52:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:52:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.754+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 msgr2=0x7fefc40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.754+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 0x7fefc40a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd0098110 tx=0x7fefd0000bc0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.754+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 msgr2=0x7fefe0199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.754+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9c0 tx=0x7fefd000ee80 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 shutdown_connections 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fefc40a2c90 0x7fefc40a5150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe0105720 0x7fefe01a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fefe0104d60 0x7fefe019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 --2- 172.21.15.144:0/3744012014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0103b70 0x7fefe0199df0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 >> 172.21.15.144:0/3744012014 conn(0x7fefe00ff2f0 msgr2=0x7fefe01080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 shutdown_connections 2024-09-05T07:52:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:18.756+0000 7fefe4c00640 1 -- 172.21.15.144:0/3744012014 wait complete. 2024-09-05T07:52:18.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:18 smithi144 ceph-mon[29535]: pgmap v381: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:18 smithi175 ceph-mon[34585]: pgmap v381: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-05T07:52:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:20 smithi154 ceph-mon[34710]: pgmap v382: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-05T07:52:20.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:20 smithi144 ceph-mon[29535]: pgmap v382: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-05T07:52:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:20 smithi175 ceph-mon[34585]: pgmap v382: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-05T07:52:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:22 smithi154 ceph-mon[34710]: pgmap v383: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:52:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:22 smithi144 ceph-mon[29535]: pgmap v383: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:52:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:22 smithi175 ceph-mon[34585]: pgmap v383: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:52:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:24 smithi154 ceph-mon[34710]: pgmap v384: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-05T07:52:24.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:24 smithi144 ceph-mon[29535]: pgmap v384: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-05T07:52:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:24 smithi175 ceph-mon[34585]: pgmap v384: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-05T07:52:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:26 smithi154 ceph-mon[34710]: pgmap v385: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:26 smithi144 ceph-mon[29535]: pgmap v385: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:26 smithi175 ceph-mon[34585]: pgmap v385: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:28 smithi154 ceph-mon[34710]: pgmap v386: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:28.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:28 smithi144 ceph-mon[29535]: pgmap v386: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:28 smithi175 ceph-mon[34585]: pgmap v386: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:29.631 INFO:tasks.workunit.client.0.smithi144.stderr:Updating files: 65% (8489/12892) Updating files: 66% (8509/12892) Updating files: 67% (8638/12892) Updating files: 68% (8767/12892) Updating files: 69% (8896/12892) Updating files: 70% (9025/12892) Updating files: 71% (9154/12892) Updating files: 72% (9283/12892) Updating files: 73% (9412/12892) Updating files: 74% (9541/12892) Updating files: 75% (9669/12892) Updating files: 76% (9798/12892) Updating files: 77% (9927/12892) Updating files: 78% (10056/12892) Updating files: 79% (10185/12892) Updating files: 80% (10314/12892) Updating files: 81% (10443/12892) Updating files: 82% (10572/12892) Updating files: 83% (10701/12892) Updating files: 84% (10830/12892) Updating files: 85% (10959/12892) Updating files: 86% (11088/12892) Updating files: 87% (11217/12892) Updating files: 88% (11345/12892) Updating files: 89% (11474/12892) Updating files: 90% (11603/12892) Updating files: 91% (11732/12892) Updating files: 92% (11861/12892) Updating files: 93% (11990/12892) Updating files: 94% (12119/12892) Updating files: 95% (12248/12892) Updating files: 96% (12377/12892) Updating files: 97% (12506/12892) Updating files: 98% (12635/12892) Updating files: 99% (12764/12892) Updating files: 100% (12892/12892) Updating files: 100% (12892/12892), done. 2024-09-05T07:52:30.575 INFO:tasks.workunit.client.0.smithi144.stderr:Note: switching to '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'. 2024-09-05T07:52:30.575 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.575 INFO:tasks.workunit.client.0.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T07:52:30.575 INFO:tasks.workunit.client.0.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: git switch -c 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr:Or undo this operation with: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: git switch - 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T07:52:30.576 INFO:tasks.workunit.client.0.smithi144.stderr: 2024-09-05T07:52:30.577 INFO:tasks.workunit.client.0.smithi144.stderr:HEAD is now at 91c8a7e56f7 Merge pull request #59582 from zdover23/wip-doc-2024-09-04-backport-59546-to-squid 2024-09-05T07:52:30.588 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T07:52:30.677 INFO:tasks.workunit.client.0.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T07:52:30.681 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T07:52:30.682 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T07:52:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:30 smithi154 ceph-mon[34710]: pgmap v387: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-05T07:52:30.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:30 smithi144 ceph-mon[29535]: pgmap v387: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-05T07:52:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:30 smithi175 ceph-mon[34585]: pgmap v387: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-05T07:52:31.519 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T07:52:31.640 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T07:52:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:52:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:31 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.709 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T07:52:31.713 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T07:52:31.713 INFO:tasks.workunit.client.0.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T07:52:31.779 INFO:tasks.workunit.client.0.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T07:52:31.787 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:52:31.787 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T07:52:31.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:52:31.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:31 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.823 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-05T07:52:31.825 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-05T07:52:31.825 DEBUG:teuthology.orchestra.run.smithi144:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-05T07:52:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:52:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:31 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 -- 172.21.15.144:0/2489655619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8077df0 msgr2=0x7f88e8078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 --2- 172.21.15.144:0/2489655619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8077df0 0x7f88e8078250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009900 tx=0x7f88d402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 -- 172.21.15.144:0/2489655619 shutdown_connections 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 --2- 172.21.15.144:0/2489655619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 0x7f88e8079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 --2- 172.21.15.144:0/2489655619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8077df0 0x7f88e8078250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 --2- 172.21.15.144:0/2489655619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8076bb0 0x7f88e8076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 -- 172.21.15.144:0/2489655619 >> 172.21.15.144:0/2489655619 conn(0x7f88e80ff4e0 msgr2=0x7f88e8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 -- 172.21.15.144:0/2489655619 shutdown_connections 2024-09-05T07:52:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.882+0000 7f88efc00640 1 -- 172.21.15.144:0/2489655619 wait complete. 2024-09-05T07:52:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.883+0000 7f88efc00640 1 Processor -- start 2024-09-05T07:52:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.883+0000 7f88efc00640 1 -- start start 2024-09-05T07:52:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8077df0 0x7f88e819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 0x7f88e81a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88e8113e10 con 0x7f88e8076bb0 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88e8113c90 con 0x7f88e8078790 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88efc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88e8113f90 con 0x7f88e8077df0 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52312/0 (socket says 172.21.15.144:52312) 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88ed200640 1 -- 172.21.15.144:0/3994174920 learned_addr learned my addr 172.21.15.144:0/3994174920 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88e7e00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8077df0 0x7f88e819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.884+0000 7f88edc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 0x7f88e81a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 -- 172.21.15.144:0/3994174920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8077df0 msgr2=0x7f88e819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8077df0 0x7f88e819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 -- 172.21.15.144:0/3994174920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 msgr2=0x7f88e81a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 0x7f88e81a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 -- 172.21.15.144:0/3994174920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e81a5fc0 con 0x7f88e8076bb0 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88ed200640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00ea60 tx=0x7f88dc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88e5600640 1 -- 172.21.15.144:0/3994174920 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00cde0 con 0x7f88e8076bb0 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88e5600640 1 -- 172.21.15.144:0/3994174920 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88dc0035f0 con 0x7f88e8076bb0 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e81a62b0 con 0x7f88e8076bb0 2024-09-05T07:52:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.885+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e81a67d0 con 0x7f88e8076bb0 2024-09-05T07:52:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.886+0000 7f88e5600640 1 -- 172.21.15.144:0/3994174920 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc010670 con 0x7f88e8076bb0 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 Processor -- start 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 -- start start 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d6c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d6ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec20ccc100 con 0x55ec20d679d0 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec20c741b0 con 0x55ec20d6ca60 2024-09-05T07:52:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.889+0000 7f88f2c32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ec20cc80c0 con 0x55ec20d67090 2024-09-05T07:52:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:54594/0 (socket says 172.21.15.144:54594) 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 -- 172.21.15.144:0/3772235659 learned_addr learned my addr 172.21.15.144:0/3772235659 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88e7e00640 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d6ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88e5600640 1 -- 172.21.15.144:0/3994174920 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f88dc0037a0 con 0x7f88e8076bb0 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 -- 172.21.15.144:0/3772235659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 msgr2=0x55ec20d6ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d6ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 -- 172.21.15.144:0/3772235659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 msgr2=0x55ec20d6c490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d6c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.890+0000 7f88edc00640 1 -- 172.21.15.144:0/3772235659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec209df210 con 0x55ec20d67090 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.891+0000 7f88edc00640 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88e0010370 tx=0x7f88e0010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef9299b94535a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.891+0000 7f88da000640 1 -- 172.21.15.144:0/3772235659 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0016070 con 0x55ec20d67090 2024-09-05T07:52:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.891+0000 7f88da000640 1 -- 172.21.15.144:0/3772235659 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0004d20 con 0x55ec20d67090 2024-09-05T07:52:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.891+0000 7f88da000640 1 -- 172.21.15.144:0/3772235659 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0005480 con 0x55ec20d67090 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 -- 172.21.15.144:0/3772235659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 msgr2=0x55ec20d67490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88e0010370 tx=0x7f88e0010830 comp rx=0 tx=0).stop 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 -- 172.21.15.144:0/3772235659 shutdown_connections 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d6ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d6c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 --2- 172.21.15.144:0/3772235659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d67490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 -- 172.21.15.144:0/3772235659 >> 172.21.15.144:0/3772235659 conn(0x55ec20d62700 msgr2=0x55ec20d62b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 -- 172.21.15.144:0/3772235659 shutdown_connections 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88f2c32740 1 -- 172.21.15.144:0/3772235659 wait complete. 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.892+0000 7f88e5600640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 0x7f88d00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.893+0000 7f88edc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 0x7f88d00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.893+0000 7f88f2c32740 1 -- start start 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.893+0000 7f88e5600640 1 -- 172.21.15.144:0/3994174920 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f88dc0cf4c0 con 0x7f88e8076bb0 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.893+0000 7f88f2c32740 1 Processor -- start 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.893+0000 7f88edc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 0x7f88d00a50a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f88e0010d30 tx=0x7f88e0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20d78810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec20d6fa30 con 0x55ec20d67090 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec20c55090 con 0x55ec20d679d0 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ec20d6fbb0 con 0x55ec20d6ca60 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88f2c32740 10 client.0 _ll_register_callbacks cb 0x55ec20ca9f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52334/0 (socket says 172.21.15.144:52334) 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 -- 172.21.15.144:0/2534478810 learned_addr learned my addr 172.21.15.144:0/2534478810 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88edc00640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20d78810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 -- 172.21.15.144:0/2534478810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 msgr2=0x55ec20d78810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20d78810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.894+0000 7f88ed200640 1 -- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 msgr2=0x55ec20d717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88ed200640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88ed200640 1 -- 172.21.15.144:0/2534478810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec20aab620 con 0x55ec20d67090 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88ed200640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f88dc098520 tx=0x7f88dc09b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bb616fa307e539 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88cea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc09ff00 con 0x55ec20d67090 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f88dc0cf110 con 0x55ec20d67090 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e0004d20 con 0x55ec20d67090 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88dc0b9050 con 0x55ec20d67090 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88f2c32740 10 client.15216 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.895+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec20d7b670 con 0x55ec20d67090 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0004d20 con 0x55ec20d67090 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f88dc0ba2d0 con 0x55ec20d67090 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 10 client.15216 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 20 client.15216 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20d7cd40 0x55ec20d7f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 4 client.15216 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec20cd9830 con 0x55ec20d7cd40 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.896+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20d7cd40 0x55ec20d7f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.897+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20d7cd40 0x55ec20d7f130 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f02b5ba99ebe3d server_cookie=e8ea17fb1df4209a in_seq=0 out_seq=0 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.897+0000 7f88cea00640 10 client.15216 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.897+0000 7f88cea00640 1 -- 172.21.15.144:0/2534478810 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec20cd9830 con 0x55ec20d7cd40 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.897+0000 7f88cea00640 10 client.15216 handle_command_reply: tid=0 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.897+0000 7f88f2c32740 1 client.15216 shutdown 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 msgr2=0x55ec20d71290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f88dc098520 tx=0x7f88dc09b4b0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 shutdown_connections 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20d7cd40 0x55ec20d7f130 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20d78810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88cea00640 0 client.15216 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2534478810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d71290 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 >> 172.21.15.144:0/2534478810 conn(0x55ec20d62700 msgr2=0x55ec20d63f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 shutdown_connections 2024-09-05T07:52:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 1 -- 172.21.15.144:0/2534478810 wait complete. 2024-09-05T07:52:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.898+0000 7f88f2c32740 20 client.15216 trim_cache size 0 max 16384 2024-09-05T07:52:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 Processor -- start 2024-09-05T07:52:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 -- start start 2024-09-05T07:52:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d64030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81af670 con 0x55ec20d679d0 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81b11b0 con 0x55ec20d6ca60 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.913+0000 7f88f2c32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81afd40 con 0x55ec20d67090 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88ed200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d64030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d787d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52348/0 (socket says 172.21.15.144:52348) 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88ed200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:54610/0 (socket says 172.21.15.144:54610) 2024-09-05T07:52:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88e7e00640 1 -- 172.21.15.144:0/2680188213 learned_addr learned my addr 172.21.15.144:0/2680188213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 -- 172.21.15.144:0/2680188213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 msgr2=0x55ec20d63af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 -- 172.21.15.144:0/2680188213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 msgr2=0x55ec20d787d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d787d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88edc00640 1 -- 172.21.15.144:0/2680188213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec20d62520 con 0x55ec20d6ca60 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.914+0000 7f88ed200640 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.915+0000 7f88edc00640 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d64030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88e0015040 tx=0x7f88e0010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981c82d20f31ae46 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.915+0000 7f88d9600640 1 -- 172.21.15.144:0/2680188213 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0005020 con 0x55ec20d6ca60 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.915+0000 7f88d9600640 1 -- 172.21.15.144:0/2680188213 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e00056a0 con 0x55ec20d6ca60 2024-09-05T07:52:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.915+0000 7f88d9600640 1 -- 172.21.15.144:0/2680188213 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0028b70 con 0x55ec20d6ca60 2024-09-05T07:52:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 -- 172.21.15.144:0/2680188213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 msgr2=0x55ec20d64030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d64030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88e0015040 tx=0x7f88e0010830 comp rx=0 tx=0).stop 2024-09-05T07:52:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 -- 172.21.15.144:0/2680188213 shutdown_connections 2024-09-05T07:52:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d6ca60 0x55ec20d64030 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d679d0 0x55ec20d787d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2680188213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d67090 0x55ec20d63af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 -- 172.21.15.144:0/2680188213 >> 172.21.15.144:0/2680188213 conn(0x55ec20d62700 msgr2=0x55ec20d708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 -- 172.21.15.144:0/2680188213 shutdown_connections 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.916+0000 7f88f2c32740 1 -- 172.21.15.144:0/2680188213 wait complete. 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 -- start start 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 Processor -- start 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d757e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20de5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81b0ae0 con 0x55ec20d67090 2024-09-05T07:52:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81b0410 con 0x55ec20d679d0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81ad650 con 0x55ec20d6ca60 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88f2c32740 10 client.0 _ll_register_callbacks cb 0x7f88dc00ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:46886/0 (socket says 172.21.15.144:46886) 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.917+0000 7f88e7e00640 1 -- 172.21.15.144:0/2014249656 learned_addr learned my addr 172.21.15.144:0/2014249656 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88edc00640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20de5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 -- 172.21.15.144:0/2014249656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 msgr2=0x55ec20de5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20de5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 -- 172.21.15.144:0/2014249656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 msgr2=0x55ec20d757e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d757e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 -- 172.21.15.144:0/2014249656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec20de5eb0 con 0x55ec20d679d0 2024-09-05T07:52:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88edc00640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20de5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88e7e00640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009230 tx=0x7f88d4004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838ab4ae808fd86a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88cea00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4035040 con 0x55ec20d679d0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e00056a0 con 0x55ec20d679d0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.918+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f88d4005510 con 0x55ec20d679d0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88d4004770 con 0x55ec20d679d0 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 10 client.25217 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec20de71e0 con 0x55ec20d679d0 2024-09-05T07:52:31.923 INFO:tasks.workunit.client.0.smithi144.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-05T07:52:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e00056a0 con 0x55ec20d679d0 2024-09-05T07:52:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f88d4031ce0 con 0x55ec20d679d0 2024-09-05T07:52:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 10 client.25217 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 10 client.25217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 20 client.25217 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20de7b90 0x55ec20de9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 4 client.25217 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.919+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec20cd3b80 con 0x55ec20de7b90 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.920+0000 7f88ed200640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20de7b90 0x55ec20de9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.920+0000 7f88ed200640 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20de7b90 0x55ec20de9fb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1943873f5bbaf26c server_cookie=3ee7f9a063cc0db8 in_seq=0 out_seq=0 2024-09-05T07:52:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.920+0000 7f88cea00640 10 client.25217 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88cea00640 1 -- 172.21.15.144:0/2014249656 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec20cd3b80 con 0x55ec20de7b90 2024-09-05T07:52:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88cea00640 10 client.25217 handle_command_reply: tid=0 2024-09-05T07:52:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 client.25217 shutdown 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 msgr2=0x55ec20d75d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009230 tx=0x7f88d4004470 comp rx=0 tx=0).stop 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 shutdown_connections 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55ec20de7b90 0x55ec20de9fb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec20d679d0 0x55ec20d75d20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ec20d6ca60 0x55ec20de5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 --2- 172.21.15.144:0/2014249656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec20d67090 0x55ec20d757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88cea00640 0 client.25217 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 >> 172.21.15.144:0/2014249656 conn(0x55ec20d62700 msgr2=0x55ec20d710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 shutdown_connections 2024-09-05T07:52:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 1 -- 172.21.15.144:0/2014249656 wait complete. 2024-09-05T07:52:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.928+0000 7f88f2c32740 20 client.25217 trim_cache size 0 max 16384 2024-09-05T07:52:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:52:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:52:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:52:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 msgr2=0x7f88d00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 0x7f88d00a50a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f88e0010d30 tx=0x7f88e0005fd0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 msgr2=0x7f88e819e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00ea60 tx=0x7f88dc00ef20 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 shutdown_connections 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f88d00a2be0 0x7f88d00a50a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8078790 0x7f88e81a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e8077df0 0x7f88e819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 --2- 172.21.15.144:0/3994174920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88e8076bb0 0x7f88e819e3a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 >> 172.21.15.144:0/3994174920 conn(0x7f88e80ff4e0 msgr2=0x7f88e8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 shutdown_connections 2024-09-05T07:52:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:31.929+0000 7f88efc00640 1 -- 172.21.15.144:0/3994174920 wait complete. 2024-09-05T07:52:32.019 INFO:tasks.workunit.client.0.smithi144.stdout: Iozone: Performance Test of File I/O 2024-09-05T07:52:32.019 INFO:tasks.workunit.client.0.smithi144.stdout: Version $Revision: 3.494 $ 2024-09-05T07:52:32.019 INFO:tasks.workunit.client.0.smithi144.stdout: Compiled for 64 bit mode. 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Build: linux-AMD64 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-05T07:52:32.020 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Run began: Thu Sep 5 07:52:31 2024 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Include close in write timing 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Include fsync in write timing 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: File size set to 1048576 kB 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Record Size 16 kB 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Output is in kBytes/sec 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Time Resolution = 0.000001 seconds. 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache size set to 1024 kBytes. 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache line size set to 32 bytes. 2024-09-05T07:52:32.021 INFO:tasks.workunit.client.0.smithi144.stdout: File stride size set to 17 * record size. 2024-09-05T07:52:32.022 INFO:tasks.workunit.client.0.smithi144.stdout: Throughput test with 1 process 2024-09-05T07:52:32.022 INFO:tasks.workunit.client.0.smithi144.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-05T07:52:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: pgmap v388: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:52:32.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:52:32.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:32 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: pgmap v388: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:32.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:52:32.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:52:32.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:32 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: pgmap v388: 97 pgs: 97 active+clean; 673 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:52:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:32 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:52:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:34 smithi154 ceph-mon[34710]: pgmap v389: 97 pgs: 97 active+clean; 710 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-05T07:52:34.827 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:34 smithi144 ceph-mon[29535]: pgmap v389: 97 pgs: 97 active+clean; 710 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-05T07:52:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:34 smithi175 ceph-mon[34585]: pgmap v389: 97 pgs: 97 active+clean; 710 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 initial writers = 275345.12 kB/sec 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 initial writers = 275297.86 kB/sec 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 275345.12 kB/sec 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 275345.12 kB/sec 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 275345.12 kB/sec 2024-09-05T07:52:35.832 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:52:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:36 smithi144 ceph-mon[29535]: pgmap v390: 97 pgs: 97 active+clean; 173 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2024-09-05T07:52:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:36 smithi144 ceph-mon[29535]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-05T07:52:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:36 smithi175 ceph-mon[34585]: pgmap v390: 97 pgs: 97 active+clean; 173 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2024-09-05T07:52:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:36 smithi175 ceph-mon[34585]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-05T07:52:36.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:36 smithi154 ceph-mon[34710]: pgmap v390: 97 pgs: 97 active+clean; 173 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2024-09-05T07:52:36.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:36 smithi154 ceph-mon[34710]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-05T07:52:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:38 smithi144 ceph-mon[29535]: pgmap v391: 97 pgs: 97 active+clean; 277 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 23 MiB/s wr, 18 op/s 2024-09-05T07:52:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:38 smithi175 ceph-mon[34585]: pgmap v391: 97 pgs: 97 active+clean; 277 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 23 MiB/s wr, 18 op/s 2024-09-05T07:52:38.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:38 smithi154 ceph-mon[34710]: pgmap v391: 97 pgs: 97 active+clean; 277 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 23 MiB/s wr, 18 op/s 2024-09-05T07:52:40.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:40 smithi144 ceph-mon[29535]: pgmap v392: 97 pgs: 97 active+clean; 833 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 33 op/s 2024-09-05T07:52:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:40 smithi175 ceph-mon[34585]: pgmap v392: 97 pgs: 97 active+clean; 833 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 33 op/s 2024-09-05T07:52:40.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:40 smithi154 ceph-mon[34710]: pgmap v392: 97 pgs: 97 active+clean; 833 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 33 op/s 2024-09-05T07:52:42.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:42 smithi144 ceph-mon[29535]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 85 MiB/s wr, 34 op/s 2024-09-05T07:52:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:42 smithi175 ceph-mon[34585]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 85 MiB/s wr, 34 op/s 2024-09-05T07:52:42.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:42 smithi154 ceph-mon[34710]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 85 MiB/s wr, 34 op/s 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 rewriters = 334909.22 kB/sec 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 rewriters = 334821.74 kB/sec 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 334909.22 kB/sec 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 334909.22 kB/sec 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 334909.22 kB/sec 2024-09-05T07:52:43.207 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:52:44.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:44 smithi144 ceph-mon[29535]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 111 MiB/s wr, 44 op/s 2024-09-05T07:52:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:44 smithi175 ceph-mon[34585]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 111 MiB/s wr, 44 op/s 2024-09-05T07:52:44.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:44 smithi154 ceph-mon[34710]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 111 MiB/s wr, 44 op/s 2024-09-05T07:52:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.054+0000 7f4af3800640 1 -- 172.21.15.144:0/3383435443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec102d50 msgr2=0x7f4aec1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.054+0000 7f4af3800640 1 --2- 172.21.15.144:0/3383435443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec102d50 0x7f4aec1031d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009900 tx=0x7f4ad802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 -- 172.21.15.144:0/3383435443 shutdown_connections 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 --2- 172.21.15.144:0/3383435443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec103710 0x7f4aec109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 --2- 172.21.15.144:0/3383435443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec102d50 0x7f4aec1031d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 --2- 172.21.15.144:0/3383435443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec101b60 0x7f4aec101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 -- 172.21.15.144:0/3383435443 >> 172.21.15.144:0/3383435443 conn(0x7f4aec0fd2e0 msgr2=0x7f4aec0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 -- 172.21.15.144:0/3383435443 shutdown_connections 2024-09-05T07:52:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.055+0000 7f4af3800640 1 -- 172.21.15.144:0/3383435443 wait complete. 2024-09-05T07:52:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 Processor -- start 2024-09-05T07:52:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 -- start start 2024-09-05T07:52:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 0x7f4aec075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec102d50 0x7f4aec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10d830 con 0x7f4aec103710 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10d6b0 con 0x7f4aec101b60 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af3800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10d9b0 con 0x7f4aec102d50 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 0x7f4aec075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34758/0 (socket says 172.21.15.144:34758) 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.056+0000 7f4af1800640 1 -- 172.21.15.144:0/3174102718 learned_addr learned my addr 172.21.15.144:0/3174102718 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 -- 172.21.15.144:0/3174102718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec102d50 msgr2=0x7f4aec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec102d50 0x7f4aec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 -- 172.21.15.144:0/3174102718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 msgr2=0x7f4aec075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 0x7f4aec075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 -- 172.21.15.144:0/3174102718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec0753b0 con 0x7f4aec103710 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af0e00640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 0x7f4aec075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4af1800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009fd0 tx=0x7f4ae400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4ae9600640 1 -- 172.21.15.144:0/3174102718 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017070 con 0x7f4aec103710 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.057+0000 7f4ae9600640 1 -- 172.21.15.144:0/3174102718 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae4003e50 con 0x7f4aec103710 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.058+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec1a1f40 con 0x7f4aec103710 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.058+0000 7f4ae9600640 1 -- 172.21.15.144:0/3174102718 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40106c0 con 0x7f4aec103710 2024-09-05T07:52:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.058+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1a23b0 con 0x7f4aec103710 2024-09-05T07:52:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.060+0000 7f4af67e2740 1 Processor -- start 2024-09-05T07:52:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4ae9600640 1 -- 172.21.15.144:0/3174102718 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4ae4003970 con 0x7f4aec103710 2024-09-05T07:52:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 -- start start 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 0x55e729d3c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d41490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d43f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e729ca1100 con 0x55e729d3c9d0 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e729c491b0 con 0x55e729d3c090 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af67e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e729c9d0c0 con 0x55e729d41a60 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 0x55e729d3c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4af0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d41490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 0x55e729d3c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:46204/0 (socket says 172.21.15.144:46204) 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.061+0000 7f4aebe00640 1 -- 172.21.15.144:0/1275855605 learned_addr learned my addr 172.21.15.144:0/1275855605 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4aebe00640 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d43f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 -- 172.21.15.144:0/1275855605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 msgr2=0x55e729d43f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d43f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 -- 172.21.15.144:0/1275855605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 msgr2=0x55e729d3c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 0x55e729d3c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 -- 172.21.15.144:0/1275855605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7299b4210 con 0x55e729d3c9d0 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4ae9600640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 0x7f4ad40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d41490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009fa0 tx=0x7f4ae00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f608efc1314920f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4ae9600640 1 -- 172.21.15.144:0/3174102718 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f4ae40ced60 con 0x7f4aec103710 2024-09-05T07:52:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4ade000640 1 -- 172.21.15.144:0/1275855605 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004030 con 0x55e729d3c9d0 2024-09-05T07:52:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.062+0000 7f4aebe00640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 0x7f4ad40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4ade000640 1 -- 172.21.15.144:0/1275855605 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae00041d0 con 0x55e729d3c9d0 2024-09-05T07:52:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4ade000640 1 -- 172.21.15.144:0/1275855605 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000f910 con 0x55e729d3c9d0 2024-09-05T07:52:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 -- 172.21.15.144:0/1275855605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 msgr2=0x55e729d41490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4aebe00640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 0x7f4ad40a50f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8031610 tx=0x7f4ad8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d41490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009fa0 tx=0x7f4ae00118d0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 -- 172.21.15.144:0/1275855605 shutdown_connections 2024-09-05T07:52:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d43f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d41490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.063+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1275855605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c090 0x55e729d3c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.064+0000 7f4af67e2740 1 -- 172.21.15.144:0/1275855605 >> 172.21.15.144:0/1275855605 conn(0x55e729d37700 msgr2=0x55e729d37b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.064+0000 7f4af67e2740 1 -- 172.21.15.144:0/1275855605 shutdown_connections 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.064+0000 7f4af67e2740 1 -- 172.21.15.144:0/1275855605 wait complete. 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.064+0000 7f4af67e2740 1 -- start start 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.064+0000 7f4af67e2740 1 Processor -- start 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729d4d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e729d44a30 con 0x55e729d3c9d0 2024-09-05T07:52:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e729c2a090 con 0x55e729d41a60 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e729d44bb0 con 0x55e729d3c090 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af67e2740 10 client.0 _ll_register_callbacks cb 0x55e729c7ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34762/0 (socket says 172.21.15.144:34762) 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4aebe00640 1 -- 172.21.15.144:0/4153900875 learned_addr learned my addr 172.21.15.144:0/4153900875 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af1800640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729d4d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 -- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 msgr2=0x55e729d4d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729d4d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 -- 172.21.15.144:0/4153900875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 msgr2=0x55e729d46810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4af0e00640 1 -- 172.21.15.144:0/4153900875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e729a80620 con 0x55e729d3c090 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.065+0000 7f4aebe00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4af0e00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d462d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0003ee0 tx=0x7f4ae0009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb3eadbb331ecab server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0028020 con 0x55e729d3c090 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f4ae0016040 con 0x55e729d3c090 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae00041d0 con 0x55e729d3c090 2024-09-05T07:52:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.066+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0033050 con 0x55e729d3c090 2024-09-05T07:52:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 10 client.25234 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e729d505d0 con 0x55e729d3c090 2024-09-05T07:52:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae00041d0 con 0x55e729d3c090 2024-09-05T07:52:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4ae0004a80 con 0x55e729d3c090 2024-09-05T07:52:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 10 client.25234 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 10 client.25234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 20 client.25234 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729d51b00 0x55e729d53ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 4 client.25234 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.067+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e729cae830 con 0x55e729d51b00 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.068+0000 7f4aebe00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729d51b00 0x55e729d53ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.068+0000 7f4aebe00640 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729d51b00 0x55e729d53ef0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749ba23a59029444 server_cookie=69adb902f1e5b883 in_seq=0 out_seq=0 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.068+0000 7f4ad2a00640 10 client.25234 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4ad2a00640 1 -- 172.21.15.144:0/4153900875 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e729cae830 con 0x55e729d51b00 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4ad2a00640 10 client.25234 handle_command_reply: tid=0 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 client.25234 shutdown 2024-09-05T07:52:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 msgr2=0x55e729d462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d462d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0003ee0 tx=0x7f4ae0009d20 comp rx=0 tx=0).stop 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 shutdown_connections 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729d51b00 0x55e729d53ef0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729d4d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d46810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4ad2a00640 0 client.25234 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 --2- 172.21.15.144:0/4153900875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d462d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.069+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 >> 172.21.15.144:0/4153900875 conn(0x55e729d37700 msgr2=0x55e729d38f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.070+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 shutdown_connections 2024-09-05T07:52:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.070+0000 7f4af67e2740 1 -- 172.21.15.144:0/4153900875 wait complete. 2024-09-05T07:52:45.078 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.070+0000 7f4af67e2740 20 client.25234 trim_cache size 0 max 16384 2024-09-05T07:52:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.084+0000 7f4af67e2740 1 Processor -- start 2024-09-05T07:52:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 -- start start 2024-09-05T07:52:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c9d0 0x55e729d4d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d36770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ab1e0 con 0x55e729d3c090 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1acd20 con 0x55e729d3c9d0 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af67e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ab8b0 con 0x55e729d41a60 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34772/0 (socket says 172.21.15.144:34772) 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af0e00640 1 -- 172.21.15.144:0/1917397349 learned_addr learned my addr 172.21.15.144:0/1917397349 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4af1800640 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d36770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.085+0000 7f4aebe00640 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c9d0 0x55e729d4d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 -- 172.21.15.144:0/1917397349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 msgr2=0x55e729d36770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d36770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 -- 172.21.15.144:0/1917397349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c9d0 msgr2=0x55e729d4d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c9d0 0x55e729d4d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 -- 172.21.15.144:0/1917397349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e729d54550 con 0x55e729d3c090 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4af0e00640 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000a010 tx=0x7f4ae00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac634432a0c106 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4add600640 1 -- 172.21.15.144:0/1917397349 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0028070 con 0x55e729d3c090 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4add600640 1 -- 172.21.15.144:0/1917397349 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae000f660 con 0x55e729d3c090 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.086+0000 7f4add600640 1 -- 172.21.15.144:0/1917397349 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0019450 con 0x55e729d3c090 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- 172.21.15.144:0/1917397349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 msgr2=0x55e729d468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000a010 tx=0x7f4ae00118d0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- 172.21.15.144:0/1917397349 shutdown_connections 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d3c9d0 0x55e729d4d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d41a60 0x55e729d36770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 --2- 172.21.15.144:0/1917397349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c090 0x55e729d468a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- 172.21.15.144:0/1917397349 >> 172.21.15.144:0/1917397349 conn(0x55e729d37700 msgr2=0x55e729d36060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- 172.21.15.144:0/1917397349 shutdown_connections 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- 172.21.15.144:0/1917397349 wait complete. 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 -- start start 2024-09-05T07:52:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.087+0000 7f4af67e2740 1 Processor -- start 2024-09-05T07:52:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d4a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729dba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ac650 con 0x55e729d3c9d0 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1abf80 con 0x55e729d41a60 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1a91c0 con 0x55e729d3c090 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af67e2740 10 client.0 _ll_register_callbacks cb 0x7f4ae0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34784/0 (socket says 172.21.15.144:34784) 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 -- 172.21.15.144:0/2337692855 learned_addr learned my addr 172.21.15.144:0/2337692855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af0e00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d4a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4af1800640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729dba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 -- 172.21.15.144:0/2337692855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 msgr2=0x55e729d4a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d4a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 -- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 msgr2=0x55e729dba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729dba7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.088+0000 7f4aebe00640 1 -- 172.21.15.144:0/2337692855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e729d4b010 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4aebe00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80314e0 tx=0x7f4ad8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a610491059e043 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8057070 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f4ad80035f0 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae000f660 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ad8063050 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4af67e2740 10 client.15237 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e729dbbe50 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.089+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae000f660 con 0x55e729d3c9d0 2024-09-05T07:52:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4ad803a040 con 0x55e729d3c9d0 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 10 client.15237 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 10 client.15237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 20 client.15237 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729dbc7b0 0x55e729dbebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 4 client.15237 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e729ca8b80 con 0x55e729dbc7b0 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af0e00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729dbc7b0 0x55e729dbebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4af0e00640 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729dbc7b0 0x55e729dbebd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2eaf2a7322136e server_cookie=ef59f77a39a8beea in_seq=0 out_seq=0 2024-09-05T07:52:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.090+0000 7f4ad2a00640 10 client.15237 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4ad2a00640 1 -- 172.21.15.144:0/2337692855 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e729ca8b80 con 0x55e729dbc7b0 2024-09-05T07:52:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4ad2a00640 10 client.15237 handle_command_reply: tid=0 2024-09-05T07:52:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 client.15237 shutdown 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 msgr2=0x55e729d4aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80314e0 tx=0x7f4ad8031400 comp rx=0 tx=0).stop 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 shutdown_connections 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55e729dbc7b0 0x55e729dbebd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e729d41a60 0x55e729dba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4ad2a00640 0 client.15237 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e729d3c9d0 0x55e729d4aa00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 --2- 172.21.15.144:0/2337692855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e729d3c090 0x55e729d4a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.098+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 >> 172.21.15.144:0/2337692855 conn(0x55e729d37700 msgr2=0x55e729d46760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 shutdown_connections 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af67e2740 1 -- 172.21.15.144:0/2337692855 wait complete. 2024-09-05T07:52:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af67e2740 20 client.15237 trim_cache size 0 max 16384 2024-09-05T07:52:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:52:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:52:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:52:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 msgr2=0x7f4ad40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 0x7f4ad40a50f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8031610 tx=0x7f4ad8000bc0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 msgr2=0x7f4aec074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009fd0 tx=0x7f4ae400b260 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 shutdown_connections 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4ad40a2c30 0x7f4ad40a50f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aec103710 0x7f4aec074b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec102d50 0x7f4aec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 --2- 172.21.15.144:0/3174102718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aec101b60 0x7f4aec075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.099+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 >> 172.21.15.144:0/3174102718 conn(0x7f4aec0fd2e0 msgr2=0x7f4aec1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.100+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 shutdown_connections 2024-09-05T07:52:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:45.100+0000 7f4af3800640 1 -- 172.21.15.144:0/3174102718 wait complete. 2024-09-05T07:52:45.971 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:45.971 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 readers = 3693079.25 kB/sec 2024-09-05T07:52:45.971 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 readers = 3685046.09 kB/sec 2024-09-05T07:52:45.971 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 3693079.25 kB/sec 2024-09-05T07:52:45.971 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 3693079.25 kB/sec 2024-09-05T07:52:45.972 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 3693079.25 kB/sec 2024-09-05T07:52:45.972 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:52:46.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:46 smithi144 ceph-mon[29535]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 160 MiB/s wr, 52 op/s 2024-09-05T07:52:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:46 smithi175 ceph-mon[34585]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 160 MiB/s wr, 52 op/s 2024-09-05T07:52:46.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:46 smithi154 ceph-mon[34710]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 160 MiB/s wr, 52 op/s 2024-09-05T07:52:48.448 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:48.448 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 re-readers = 2717511.25 kB/sec 2024-09-05T07:52:48.448 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 re-readers = 2712849.40 kB/sec 2024-09-05T07:52:48.449 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 2717511.25 kB/sec 2024-09-05T07:52:48.449 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 2717511.25 kB/sec 2024-09-05T07:52:48.449 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 2717511.25 kB/sec 2024-09-05T07:52:48.449 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:52:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:48 smithi144 ceph-mon[29535]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 152 MiB/s wr, 50 op/s 2024-09-05T07:52:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:48 smithi175 ceph-mon[34585]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 152 MiB/s wr, 50 op/s 2024-09-05T07:52:48.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:48 smithi154 ceph-mon[34710]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 152 MiB/s wr, 50 op/s 2024-09-05T07:52:50.739 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:50 smithi154 ceph-mon[34710]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 148 MiB/s wr, 52 op/s 2024-09-05T07:52:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:50 smithi144 ceph-mon[29535]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 148 MiB/s wr, 52 op/s 2024-09-05T07:52:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:50 smithi175 ceph-mon[34585]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 148 MiB/s wr, 52 op/s 2024-09-05T07:52:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:52 smithi144 ceph-mon[29535]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 101 MiB/s wr, 37 op/s 2024-09-05T07:52:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:52 smithi175 ceph-mon[34585]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 101 MiB/s wr, 37 op/s 2024-09-05T07:52:52.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:52 smithi154 ceph-mon[34710]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 101 MiB/s wr, 37 op/s 2024-09-05T07:52:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:54 smithi144 ceph-mon[29535]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 85 MiB/s wr, 36 op/s 2024-09-05T07:52:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:54 smithi175 ceph-mon[34585]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 85 MiB/s wr, 36 op/s 2024-09-05T07:52:54.940 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:54 smithi154 ceph-mon[34710]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 85 MiB/s wr, 36 op/s 2024-09-05T07:52:55.103 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.104 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.104 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.104 INFO:tasks.workunit.client.0.smithi144.stdout:iozone test complete. 2024-09-05T07:52:55.105 INFO:tasks.workunit.client.0.smithi144.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-05T07:52:55.183 INFO:tasks.workunit.client.0.smithi144.stdout: Iozone: Performance Test of File I/O 2024-09-05T07:52:55.183 INFO:tasks.workunit.client.0.smithi144.stdout: Version $Revision: 3.494 $ 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Compiled for 64 bit mode. 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Build: linux-AMD64 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-05T07:52:55.184 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Run began: Thu Sep 5 07:52:55 2024 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Include close in write timing 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Include fsync in write timing 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: File size set to 1048576 kB 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Record Size 1024 kB 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Output is in kBytes/sec 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Time Resolution = 0.000001 seconds. 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache size set to 1024 kBytes. 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache line size set to 32 bytes. 2024-09-05T07:52:55.185 INFO:tasks.workunit.client.0.smithi144.stdout: File stride size set to 17 * record size. 2024-09-05T07:52:55.186 INFO:tasks.workunit.client.0.smithi144.stdout: Throughput test with 1 process 2024-09-05T07:52:55.186 INFO:tasks.workunit.client.0.smithi144.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-05T07:52:56.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:56 smithi144 ceph-mon[29535]: pgmap v400: 97 pgs: 97 active+clean; 441 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 60 MiB/s wr, 39 op/s 2024-09-05T07:52:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:56 smithi175 ceph-mon[34585]: pgmap v400: 97 pgs: 97 active+clean; 441 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 60 MiB/s wr, 39 op/s 2024-09-05T07:52:56.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:56 smithi154 ceph-mon[34710]: pgmap v400: 97 pgs: 97 active+clean; 441 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 60 MiB/s wr, 39 op/s 2024-09-05T07:52:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.265+0000 7f1cfd600640 1 -- 172.21.15.144:0/1078159588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8076bb0 msgr2=0x7f1cf8076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.265+0000 7f1cfd600640 1 --2- 172.21.15.144:0/1078159588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8076bb0 0x7f1cf8076fb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009900 tx=0x7f1ce802a3f0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 -- 172.21.15.144:0/1078159588 shutdown_connections 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 --2- 172.21.15.144:0/1078159588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 0x7f1cf8079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 --2- 172.21.15.144:0/1078159588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf8077df0 0x7f1cf8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 --2- 172.21.15.144:0/1078159588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8076bb0 0x7f1cf8076fb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 -- 172.21.15.144:0/1078159588 >> 172.21.15.144:0/1078159588 conn(0x7f1cf80ff4e0 msgr2=0x7f1cf8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 -- 172.21.15.144:0/1078159588 shutdown_connections 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.266+0000 7f1cfd600640 1 -- 172.21.15.144:0/1078159588 wait complete. 2024-09-05T07:52:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.267+0000 7f1cfd600640 1 Processor -- start 2024-09-05T07:52:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.267+0000 7f1cfd600640 1 -- start start 2024-09-05T07:52:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 0x7f1cf819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 0x7f1cf819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8113e40 con 0x7f1cf81a3b80 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53854/0 (socket says 172.21.15.144:53854) 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cf7400640 1 -- 172.21.15.144:0/2410911350 learned_addr learned my addr 172.21.15.144:0/2410911350 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8113cc0 con 0x7f1cf8077df0 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8113fc0 con 0x7f1cf8078790 2024-09-05T07:52:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.268+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 0x7f1cf819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf7400640 1 -- 172.21.15.144:0/2410911350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 msgr2=0x7f1cf819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 0x7f1cf819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf7400640 1 -- 172.21.15.144:0/2410911350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 msgr2=0x7f1cf819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 0x7f1cf819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 0x7f1cf819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf7400640 1 -- 172.21.15.144:0/2410911350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf81a65e0 con 0x7f1cf81a3b80 2024-09-05T07:52:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.269+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 0x7f1cf819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:52:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.270+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000efd0 tx=0x7f1cf000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.270+0000 7f1cef400640 1 -- 172.21.15.144:0/2410911350 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0003b70 con 0x7f1cf81a3b80 2024-09-05T07:52:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.270+0000 7f1cef400640 1 -- 172.21.15.144:0/2410911350 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf0003d10 con 0x7f1cf81a3b80 2024-09-05T07:52:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.270+0000 7f1cef400640 1 -- 172.21.15.144:0/2410911350 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00109f0 con 0x7f1cf81a3b80 2024-09-05T07:52:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.270+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf81a68d0 con 0x7f1cf81a3b80 2024-09-05T07:52:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.271+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf81a6dd0 con 0x7f1cf81a3b80 2024-09-05T07:52:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.274+0000 7f1cef400640 1 -- 172.21.15.144:0/2410911350 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1cf0004000 con 0x7f1cf81a3b80 2024-09-05T07:52:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.276+0000 7f1cef400640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 0x7f1cdc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.276+0000 7f1cef400640 1 -- 172.21.15.144:0/2410911350 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f1cf00cf4e0 con 0x7f1cf81a3b80 2024-09-05T07:52:58.277 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.276+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 0x7f1cdc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.277+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 0x7f1cdc0a5170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8006010 tx=0x7f1ce8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.277+0000 7f1d005bd740 1 Processor -- start 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 -- start start 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d999490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f2d8fe100 con 0x559f2d99ea60 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559f2d8a61b0 con 0x559f2d9999d0 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1d005bd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f2d8fa0c0 con 0x559f2d999090 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:36426/0 (socket says 172.21.15.144:36426) 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.278+0000 7f1cf6000640 1 -- 172.21.15.144:0/2534899157 learned_addr learned my addr 172.21.15.144:0/2534899157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d999490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 -- 172.21.15.144:0/2534899157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 msgr2=0x559f2d999490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d999490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 -- 172.21.15.144:0/2534899157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 msgr2=0x559f2d9a0f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:52:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 -- 172.21.15.144:0/2534899157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2d611210 con 0x559f2d9999d0 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d999490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.279+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009c90 tx=0x7f1ce4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f4afa9d89f1e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.280+0000 7f1ce3400640 1 -- 172.21.15.144:0/2534899157 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4005220 con 0x559f2d9999d0 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.280+0000 7f1ce3400640 1 -- 172.21.15.144:0/2534899157 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ce4004c80 con 0x559f2d9999d0 2024-09-05T07:52:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.280+0000 7f1ce3400640 1 -- 172.21.15.144:0/2534899157 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4019880 con 0x559f2d9999d0 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 -- 172.21.15.144:0/2534899157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 msgr2=0x559f2d99e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009c90 tx=0x7f1ce4011810 comp rx=0 tx=0).stop 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 -- 172.21.15.144:0/2534899157 shutdown_connections 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d99e490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2534899157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d999490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 -- 172.21.15.144:0/2534899157 >> 172.21.15.144:0/2534899157 conn(0x559f2d994700 msgr2=0x559f2d994b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 -- 172.21.15.144:0/2534899157 shutdown_connections 2024-09-05T07:52:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.281+0000 7f1d005bd740 1 -- 172.21.15.144:0/2534899157 wait complete. 2024-09-05T07:52:58.283 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.282+0000 7f1d005bd740 1 -- start start 2024-09-05T07:52:58.283 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.282+0000 7f1d005bd740 1 Processor -- start 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d9b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d9bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f2d9b2a40 con 0x559f2d999090 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559f2d887090 con 0x559f2d99ea60 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f2d9b2bc0 con 0x559f2d9999d0 2024-09-05T07:52:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1d005bd740 10 client.0 _ll_register_callbacks cb 0x559f2d8dbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:35500/0 (socket says 172.21.15.144:35500) 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1cf6000640 1 -- 172.21.15.144:0/2078046624 learned_addr learned my addr 172.21.15.144:0/2078046624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d9b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.283+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d9bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 -- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 msgr2=0x559f2d9bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d9bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 -- 172.21.15.144:0/2078046624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 msgr2=0x559f2d9b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d9b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 -- 172.21.15.144:0/2078046624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2d6dd620 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4011d10 tx=0x7f1ce4009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15c62f553582c734 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4029070 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce4004c80 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f1ce4005240 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ce4034050 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1d005bd740 10 client.25249 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.284+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f2d9be550 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.285+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ce4004c80 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.285+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ce4004020 con 0x559f2d9999d0 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 10 client.25249 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 10 client.25249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 20 client.25249 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2d9bf9d0 0x559f2d9c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 4 client.25249 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:52:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f2d90b830 con 0x559f2d9bf9d0 2024-09-05T07:52:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.286+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2d9bf9d0 0x559f2d9c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.287+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2d9bf9d0 0x559f2d9c1dc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be81206124f4a21 server_cookie=c68be4847a6337f3 in_seq=0 out_seq=0 2024-09-05T07:52:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.287+0000 7f1cd7e00640 10 client.25249 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.287+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2078046624 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f2d90b830 con 0x559f2d9bf9d0 2024-09-05T07:52:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.287+0000 7f1cd7e00640 10 client.25249 handle_command_reply: tid=0 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.287+0000 7f1d005bd740 1 client.25249 shutdown 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 msgr2=0x559f2d9b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4011d10 tx=0x7f1ce4009f40 comp rx=0 tx=0).stop 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 shutdown_connections 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2d9bf9d0 0x559f2d9c1dc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d9bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9b4760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2078046624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d9b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 >> 172.21.15.144:0/2078046624 conn(0x559f2d994700 msgr2=0x559f2d995f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1cd7e00640 0 client.25249 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 shutdown_connections 2024-09-05T07:52:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.288+0000 7f1d005bd740 1 -- 172.21.15.144:0/2078046624 wait complete. 2024-09-05T07:52:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.289+0000 7f1d005bd740 20 client.25249 trim_cache size 0 max 16384 2024-09-05T07:52:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.320+0000 7f1d005bd740 1 Processor -- start 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 -- start start 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d995af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d996030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81a7450 con 0x559f2d999090 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81a8f90 con 0x559f2d99ea60 2024-09-05T07:52:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1d005bd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81a7b20 con 0x559f2d9999d0 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d995af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d995af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53886/0 (socket says 172.21.15.144:53886) 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1cf6a00640 1 -- 172.21.15.144:0/660926429 learned_addr learned my addr 172.21.15.144:0/660926429 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1cf7400640 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d996030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.321+0000 7f1cf6000640 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 -- 172.21.15.144:0/660926429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 msgr2=0x559f2d9bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 -- 172.21.15.144:0/660926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 msgr2=0x559f2d995af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d995af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 -- 172.21.15.144:0/660926429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2d98fd60 con 0x559f2d99ea60 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1cf7400640 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d996030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00ccf70 tx=0x7f1cf0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de057d96fd01edb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1ce2a00640 1 -- 172.21.15.144:0/660926429 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00a4940 con 0x559f2d99ea60 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1ce2a00640 1 -- 172.21.15.144:0/660926429 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf0099fd0 con 0x559f2d99ea60 2024-09-05T07:52:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.322+0000 7f1ce2a00640 1 -- 172.21.15.144:0/660926429 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00a4710 con 0x559f2d99ea60 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.323+0000 7f1d005bd740 1 -- 172.21.15.144:0/660926429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 msgr2=0x559f2d996030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.323+0000 7f1d005bd740 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d996030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00ccf70 tx=0x7f1cf0009f90 comp rx=0 tx=0).stop 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 -- 172.21.15.144:0/660926429 shutdown_connections 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d99ea60 0x559f2d996030 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d9999d0 0x559f2d9bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 --2- 172.21.15.144:0/660926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d999090 0x559f2d995af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 -- 172.21.15.144:0/660926429 >> 172.21.15.144:0/660926429 conn(0x559f2d994700 msgr2=0x559f2d993880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 -- 172.21.15.144:0/660926429 shutdown_connections 2024-09-05T07:52:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 -- 172.21.15.144:0/660926429 wait complete. 2024-09-05T07:52:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 -- start start 2024-09-05T07:52:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.324+0000 7f1d005bd740 1 Processor -- start 2024-09-05T07:52:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d9b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81a88c0 con 0x559f2d99ea60 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81a81f0 con 0x559f2d9999d0 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf810a340 con 0x559f2d999090 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1d005bd740 10 client.0 _ll_register_callbacks cb 0x7f1ce4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1cf6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:36452/0 (socket says 172.21.15.144:36452) 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1cf6000640 1 -- 172.21.15.144:0/2689248420 learned_addr learned my addr 172.21.15.144:0/2689248420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.325+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d9b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 -- 172.21.15.144:0/2689248420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 msgr2=0x559f2d9b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d9b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 -- 172.21.15.144:0/2689248420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 msgr2=0x559f2d9ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 -- 172.21.15.144:0/2689248420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2d9ba900 con 0x559f2d9999d0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf7400640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cf6000640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400a010 tx=0x7f1ce4003800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6fbb39231a8a8bc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce403d060 con 0x559f2d9999d0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f1ce4005240 con 0x559f2d9999d0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf0099fd0 con 0x559f2d9999d0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ce4029040 con 0x559f2d9999d0 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1d005bd740 10 client.25250 fetch_fsmap learned FSMap version 29 2024-09-05T07:52:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.326+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f2da2a630 con 0x559f2d9999d0 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.327+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ce4005440 con 0x559f2d9999d0 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.328+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ce4019700 con 0x559f2d9999d0 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.328+0000 7f1d005bd740 10 client.25250 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.328+0000 7f1d005bd740 10 client.25250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.328+0000 7f1d005bd740 20 client.25250 populate_metadata read hostname 'smithi144' 2024-09-05T07:52:58.330 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.329+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2da2afd0 0x559f2da2d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:52:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.329+0000 7f1d005bd740 4 client.25250 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:52:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.329+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f1cf0099fd0 con 0x559f2da2afd0 2024-09-05T07:52:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.330+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2da2afd0 0x559f2da2d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:52:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.332+0000 7f1cf6a00640 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2da2afd0 0x559f2da2d3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3dc553dfd52c7ba server_cookie=4e716e10b81d9954 in_seq=0 out_seq=0 2024-09-05T07:52:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.333+0000 7f1cd7e00640 10 client.25250 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.347+0000 7f1cd7e00640 1 -- 172.21.15.144:0/2689248420 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f1cf0099fd0 con 0x559f2da2afd0 2024-09-05T07:52:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.347+0000 7f1cd7e00640 10 client.25250 handle_command_reply: tid=0 2024-09-05T07:52:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.347+0000 7f1d005bd740 1 client.25250 shutdown 2024-09-05T07:52:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.347+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 msgr2=0x559f2d9b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.347+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400a010 tx=0x7f1ce4003800 comp rx=0 tx=0).stop 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 shutdown_connections 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x559f2da2afd0 0x559f2da2d3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f2d9999d0 0x559f2d9b92e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f2d99ea60 0x559f2d9ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 --2- 172.21.15.144:0/2689248420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f2d999090 0x559f2d9b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1cd7e00640 0 client.25250 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 >> 172.21.15.144:0/2689248420 conn(0x559f2d994700 msgr2=0x559f2d994ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 shutdown_connections 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 1 -- 172.21.15.144:0/2689248420 wait complete. 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.348+0000 7f1d005bd740 20 client.25250 trim_cache size 0 max 16384 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:52:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 msgr2=0x7f1cdc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 0x7f1cdc0a5170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8006010 tx=0x7f1ce8000bc0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 msgr2=0x7f1cf81a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000efd0 tx=0x7f1cf000c6a0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 shutdown_connections 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f1cdc0a2cb0 0x7f1cdc0a5170 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf81a3b80 0x7f1cf81a5f70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf8078790 0x7f1cf819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 --2- 172.21.15.144:0/2410911350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8077df0 0x7f1cf819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:52:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.349+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 >> 172.21.15.144:0/2410911350 conn(0x7f1cf80ff4e0 msgr2=0x7f1cf8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:52:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.350+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 shutdown_connections 2024-09-05T07:52:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:52:58.350+0000 7f1cfd600640 1 -- 172.21.15.144:0/2410911350 wait complete. 2024-09-05T07:52:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:52:58 smithi144 ceph-mon[29535]: pgmap v401: 97 pgs: 97 active+clean; 345 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-09-05T07:52:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:52:58 smithi175 ceph-mon[34585]: pgmap v401: 97 pgs: 97 active+clean; 345 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-09-05T07:52:58.927 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 initial writers = 282593.22 kB/sec 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 initial writers = 282537.70 kB/sec 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 282593.22 kB/sec 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 282593.22 kB/sec 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 282593.22 kB/sec 2024-09-05T07:52:58.928 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:52:58.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:52:58 smithi154 ceph-mon[34710]: pgmap v401: 97 pgs: 97 active+clean; 345 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-09-05T07:53:00.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:00 smithi144 ceph-mon[29535]: pgmap v402: 97 pgs: 97 active+clean; 361 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 34 MiB/s wr, 45 op/s 2024-09-05T07:53:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:00 smithi175 ceph-mon[34585]: pgmap v402: 97 pgs: 97 active+clean; 361 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 34 MiB/s wr, 45 op/s 2024-09-05T07:53:00.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:00 smithi154 ceph-mon[34710]: pgmap v402: 97 pgs: 97 active+clean; 361 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 34 MiB/s wr, 45 op/s 2024-09-05T07:53:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:02 smithi144 ceph-mon[29535]: pgmap v403: 97 pgs: 97 active+clean; 757 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 49 op/s 2024-09-05T07:53:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:02 smithi175 ceph-mon[34585]: pgmap v403: 97 pgs: 97 active+clean; 757 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 49 op/s 2024-09-05T07:53:02.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:02 smithi154 ceph-mon[34710]: pgmap v403: 97 pgs: 97 active+clean; 757 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 49 op/s 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 rewriters = 333784.62 kB/sec 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 rewriters = 333709.17 kB/sec 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 333784.62 kB/sec 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 333784.62 kB/sec 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 333784.62 kB/sec 2024-09-05T07:53:04.408 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:53:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:04 smithi144 ceph-mon[29535]: pgmap v404: 97 pgs: 97 active+clean; 993 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 93 MiB/s wr, 62 op/s 2024-09-05T07:53:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:04 smithi175 ceph-mon[34585]: pgmap v404: 97 pgs: 97 active+clean; 993 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 93 MiB/s wr, 62 op/s 2024-09-05T07:53:04.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:04 smithi154 ceph-mon[34710]: pgmap v404: 97 pgs: 97 active+clean; 993 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 93 MiB/s wr, 62 op/s 2024-09-05T07:53:06.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:06 smithi144 ceph-mon[29535]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 138 MiB/s wr, 71 op/s 2024-09-05T07:53:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:06 smithi175 ceph-mon[34585]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 138 MiB/s wr, 71 op/s 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 readers = 4709440.50 kB/sec 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 readers = 4694575.60 kB/sec 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 4709440.50 kB/sec 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 4709440.50 kB/sec 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 4709440.50 kB/sec 2024-09-05T07:53:06.921 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:53:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:06 smithi154 ceph-mon[34710]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 138 MiB/s wr, 71 op/s 2024-09-05T07:53:08.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:08 smithi144 ceph-mon[29535]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 145 MiB/s wr, 60 op/s 2024-09-05T07:53:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:08 smithi175 ceph-mon[34585]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 145 MiB/s wr, 60 op/s 2024-09-05T07:53:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:08 smithi154 ceph-mon[34710]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 145 MiB/s wr, 60 op/s 2024-09-05T07:53:09.298 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 re-readers = 3403903.25 kB/sec 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 re-readers = 3395923.68 kB/sec 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 3403903.25 kB/sec 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 3403903.25 kB/sec 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 3403903.25 kB/sec 2024-09-05T07:53:09.299 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 1048576.00 kB 2024-09-05T07:53:09.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:09 smithi175 ceph-mon[34585]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 66 op/s 2024-09-05T07:53:09.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:09 smithi154 ceph-mon[34710]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 66 op/s 2024-09-05T07:53:10.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:09 smithi144 ceph-mon[29535]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 66 op/s 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 -- 172.21.15.144:0/993568259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8103d60 msgr2=0x7fcab8104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 --2- 172.21.15.144:0/993568259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8103d60 0x7fcab8104160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009860 tx=0x7fcaa802a340 comp rx=0 tx=0).stop 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 -- 172.21.15.144:0/993568259 shutdown_connections 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 --2- 172.21.15.144:0/993568259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8104f50 0x7fcab81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 --2- 172.21.15.144:0/993568259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8105910 0x7fcab810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.482+0000 7fcabf400640 1 --2- 172.21.15.144:0/993568259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8103d60 0x7fcab8104160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.483+0000 7fcabf400640 1 -- 172.21.15.144:0/993568259 >> 172.21.15.144:0/993568259 conn(0x7fcab80ff4e0 msgr2=0x7fcab8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.483+0000 7fcabf400640 1 -- 172.21.15.144:0/993568259 shutdown_connections 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.483+0000 7fcabf400640 1 -- 172.21.15.144:0/993568259 wait complete. 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.483+0000 7fcabf400640 1 Processor -- start 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 -- start start 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 0x7fcab8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8105910 0x7fcab81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcab810f9e0 con 0x7fcab8104f50 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcab810f860 con 0x7fcab8103d60 2024-09-05T07:53:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabf400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcab810fb60 con 0x7fcab8105910 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53360/0 (socket says 172.21.15.144:53360) 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcaafe00640 1 -- 172.21.15.144:0/1996186824 learned_addr learned my addr 172.21.15.144:0/1996186824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabca00640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 0x7fcab8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.484+0000 7fcabd400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8105910 0x7fcab81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 -- 172.21.15.144:0/1996186824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8105910 msgr2=0x7fcab81a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8105910 0x7fcab81a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 -- 172.21.15.144:0/1996186824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 msgr2=0x7fcab8199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 0x7fcab8199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 -- 172.21.15.144:0/1996186824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab81a1bf0 con 0x7fcab8104f50 2024-09-05T07:53:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcabca00640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 0x7fcab8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcaafe00640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000e9f0 tx=0x7fcaa000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcab6000640 1 -- 172.21.15.144:0/1996186824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000cd80 con 0x7fcab8104f50 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcab6000640 1 -- 172.21.15.144:0/1996186824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaa0005500 con 0x7fcab8104f50 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab81a1ee0 con 0x7fcab8104f50 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcab6000640 1 -- 172.21.15.144:0/1996186824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0010690 con 0x7fcab8104f50 2024-09-05T07:53:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.485+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab81a2350 con 0x7fcab8104f50 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.488+0000 7fcac23e8740 1 Processor -- start 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.488+0000 7fcab6000640 1 -- 172.21.15.144:0/1996186824 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fcaa00046c0 con 0x7fcab8104f50 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 -- start start 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d28490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d2d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561570c8d100 con 0x561570d2da60 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561570c351b0 con 0x561570d289d0 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcac23e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561570c890c0 con 0x561570d28090 2024-09-05T07:53:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53366/0 (socket says 172.21.15.144:53366) 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcaafe00640 1 -- 172.21.15.144:0/3185354499 learned_addr learned my addr 172.21.15.144:0/3185354499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcabca00640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d2d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.489+0000 7fcabd400640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d28490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 -- 172.21.15.144:0/3185354499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 msgr2=0x561570d28490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d28490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 -- 172.21.15.144:0/3185354499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 msgr2=0x561570d2d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d2d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 -- 172.21.15.144:0/3185354499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615709a0210 con 0x561570d2da60 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcabca00640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d2d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00d73f0 tx=0x7fcaa00d74e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec46683853eb390 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcab6000640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 0x7fca9c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaadc00640 1 -- 172.21.15.144:0/3185354499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00e3070 con 0x561570d2da60 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcab6000640 1 -- 172.21.15.144:0/1996186824 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fcaa00cf480 con 0x7fcab8104f50 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcabd400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 0x7fca9c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaadc00640 1 -- 172.21.15.144:0/3185354499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaa009c370 con 0x561570d2da60 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.490+0000 7fcaadc00640 1 -- 172.21.15.144:0/3185354499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0097f10 con 0x561570d2da60 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 -- 172.21.15.144:0/3185354499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 msgr2=0x561570d2ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00d73f0 tx=0x7fcaa00d74e0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcabd400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 0x7fca9c0a50f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005fd0 tx=0x7fcab0010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 -- 172.21.15.144:0/3185354499 shutdown_connections 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d2d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.499 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d2ff20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3185354499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d28490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 -- 172.21.15.144:0/3185354499 >> 172.21.15.144:0/3185354499 conn(0x561570d23700 msgr2=0x561570d23b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 -- 172.21.15.144:0/3185354499 shutdown_connections 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.491+0000 7fcac23e8740 1 -- 172.21.15.144:0/3185354499 wait complete. 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 -- start start 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 Processor -- start 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 0x561570d321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 0x561570d32700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561570d30a30 con 0x561570d2da60 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561570c16090 con 0x561570d28090 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.492+0000 7fcac23e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561570d30bb0 con 0x561570d289d0 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcac23e8740 10 client.0 _ll_register_callbacks cb 0x561570c6af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53378/0 (socket says 172.21.15.144:53378) 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabd400640 1 -- 172.21.15.144:0/2647968445 learned_addr learned my addr 172.21.15.144:0/2647968445 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 0x561570d321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 0x561570d32700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 -- 172.21.15.144:0/2647968445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 msgr2=0x561570d32700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 0x561570d32700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 -- 172.21.15.144:0/2647968445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 msgr2=0x561570d39740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabca00640 1 -- 172.21.15.144:0/2647968445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561570a6c620 con 0x561570d28090 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcabd400640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.493+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 0x561570d32700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcabca00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 0x561570d321c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcaa802a860 tx=0x7fcaa80095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8219e984de25996 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcaa6000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8041070 con 0x561570d28090 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fcaa8005020 con 0x561570d28090 2024-09-05T07:53:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaa009c370 con 0x561570d28090 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcaa8037040 con 0x561570d28090 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcac23e8740 10 client.25262 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561570d3c5a0 con 0x561570d28090 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.494+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaa009c370 con 0x561570d28090 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcaa8044030 con 0x561570d28090 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 10 client.25262 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 10 client.25262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 20 client.25262 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570d3dcc0 0x561570d400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 4 client.25262 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561570c9a830 con 0x561570d3dcc0 2024-09-05T07:53:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.495+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570d3dcc0 0x561570d400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.496+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570d3dcc0 0x561570d400b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03e84bfd0041602 server_cookie=e99de54f5401433 in_seq=0 out_seq=0 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.496+0000 7fcaa6000640 10 client.25262 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.496+0000 7fcaa6000640 1 -- 172.21.15.144:0/2647968445 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561570c9a830 con 0x561570d3dcc0 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.496+0000 7fcaa6000640 10 client.25262 handle_command_reply: tid=0 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.496+0000 7fcac23e8740 1 client.25262 shutdown 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 msgr2=0x561570d321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 0x561570d321c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcaa802a860 tx=0x7fcaa80095a0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 shutdown_connections 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570d3dcc0 0x561570d400b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d39740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d289d0 0x561570d32700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcaa6000640 0 client.25262 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2647968445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d28090 0x561570d321c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 >> 172.21.15.144:0/2647968445 conn(0x561570d23700 msgr2=0x561570d24f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 shutdown_connections 2024-09-05T07:53:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 1 -- 172.21.15.144:0/2647968445 wait complete. 2024-09-05T07:53:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.497+0000 7fcac23e8740 20 client.25262 trim_cache size 0 max 16384 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 Processor -- start 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 -- start start 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d24af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81ab1b0 con 0x561570d2da60 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81accf0 con 0x561570d289d0 2024-09-05T07:53:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.512+0000 7fcac23e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81ab880 con 0x561570d28090 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcabd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d24af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39310/0 (socket says 172.21.15.144:39310) 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcabd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d24af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53392/0 (socket says 172.21.15.144:53392) 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 -- 172.21.15.144:0/3725556809 learned_addr learned my addr 172.21.15.144:0/3725556809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcabca00640 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 -- 172.21.15.144:0/3725556809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 msgr2=0x561570d325e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d325e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 -- 172.21.15.144:0/3725556809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 msgr2=0x561570d24af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d24af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 -- 172.21.15.144:0/3725556809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561570d1ed60 con 0x561570d289d0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcabca00640 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaafe00640 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0098640 tx=0x7fcaa00cf700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f2b2a2719419c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaad200640 1 -- 172.21.15.144:0/3725556809 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa009b5d0 con 0x561570d289d0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaad200640 1 -- 172.21.15.144:0/3725556809 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaa009c370 con 0x561570d289d0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.513+0000 7fcaad200640 1 -- 172.21.15.144:0/3725556809 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa009b7b0 con 0x561570d289d0 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 -- 172.21.15.144:0/3725556809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 msgr2=0x561570d39700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0098640 tx=0x7fcaa00cf700 comp rx=0 tx=0).stop 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 -- 172.21.15.144:0/3725556809 shutdown_connections 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d289d0 0x561570d39700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d2da60 0x561570d24af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 --2- 172.21.15.144:0/3725556809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 -- 172.21.15.144:0/3725556809 >> 172.21.15.144:0/3725556809 conn(0x561570d23700 msgr2=0x561570d22880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 -- 172.21.15.144:0/3725556809 shutdown_connections 2024-09-05T07:53:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.514+0000 7fcac23e8740 1 -- 172.21.15.144:0/3725556809 wait complete. 2024-09-05T07:53:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 -- start start 2024-09-05T07:53:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 Processor -- start 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 0x561570d36f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d2da60 0x561570d37f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81ac620 con 0x561570d289d0 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81abf50 con 0x561570d2da60 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81a9190 con 0x561570d28090 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcac23e8740 10 client.0 _ll_register_callbacks cb 0x7fcaa0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.515+0000 7fcabca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 0x561570d36f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:53078/0 (socket says 172.21.15.144:53078) 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 -- 172.21.15.144:0/2627781086 learned_addr learned my addr 172.21.15.144:0/2627781086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabd400640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d2da60 0x561570d37f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 -- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d2da60 msgr2=0x561570d37f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d2da60 0x561570d37f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 -- 172.21.15.144:0/2627781086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 msgr2=0x561570d36f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 0x561570d36f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 -- 172.21.15.144:0/2627781086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561570d38550 con 0x561570d28090 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 0x561570d36f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcabca00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80036e0 tx=0x7fcaa8003760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67cd1d82776601f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcaa6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:53:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8056060 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.516+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fcaa8005020 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaa009c370 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcaa8041030 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 10 client.25273 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561570d398d0 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaa009c370 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcaa8044040 con 0x561570d28090 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 10 client.25273 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 10 client.25273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 20 client.25273 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570da9000 0x561570dab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 4 client.25273 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.517+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561570c94b80 con 0x561570da9000 2024-09-05T07:53:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.518+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570da9000 0x561570dab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.518+0000 7fcaa6000640 10 client.25273 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.518+0000 7fcaafe00640 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570da9000 0x561570dab420 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a26704b3aa6f22 server_cookie=4bf5c2eab7c9abcc in_seq=0 out_seq=0 2024-09-05T07:53:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcaa6000640 1 -- 172.21.15.144:0/2627781086 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561570c94b80 con 0x561570da9000 2024-09-05T07:53:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcaa6000640 10 client.25273 handle_command_reply: tid=0 2024-09-05T07:53:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 client.25273 shutdown 2024-09-05T07:53:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 msgr2=0x561570d369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80036e0 tx=0x7fcaa8003760 comp rx=0 tx=0).stop 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 shutdown_connections 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x561570da9000 0x561570dab420 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561570d2da60 0x561570d37f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561570d289d0 0x561570d36f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 --2- 172.21.15.144:0/2627781086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561570d28090 0x561570d369f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcaa6000640 0 client.25273 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.526+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 >> 172.21.15.144:0/2627781086 conn(0x561570d23700 msgr2=0x561570d22880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 shutdown_connections 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcac23e8740 1 -- 172.21.15.144:0/2627781086 wait complete. 2024-09-05T07:53:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcac23e8740 20 client.25273 trim_cache size 0 max 16384 2024-09-05T07:53:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:53:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:53:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:53:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 msgr2=0x7fca9c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 0x7fca9c0a50f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005fd0 tx=0x7fcab0010040 comp rx=0 tx=0).stop 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 msgr2=0x7fcab819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000e9f0 tx=0x7fcaa000edf0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 shutdown_connections 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fca9c0a2c30 0x7fca9c0a50f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcab8105910 0x7fcab81a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcab8104f50 0x7fcab819a510 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 --2- 172.21.15.144:0/1996186824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab8103d60 0x7fcab8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.527+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 >> 172.21.15.144:0/1996186824 conn(0x7fcab80ff4e0 msgr2=0x7fcab81082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.528+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 shutdown_connections 2024-09-05T07:53:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:11.528+0000 7fcabf400640 1 -- 172.21.15.144:0/1996186824 wait complete. 2024-09-05T07:53:12.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:12 smithi154 ceph-mon[34710]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 141 MiB/s wr, 47 op/s 2024-09-05T07:53:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:12 smithi144 ceph-mon[29535]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 141 MiB/s wr, 47 op/s 2024-09-05T07:53:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:12 smithi175 ceph-mon[34585]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 141 MiB/s wr, 47 op/s 2024-09-05T07:53:14.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:14 smithi154 ceph-mon[34710]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 108 MiB/s wr, 44 op/s 2024-09-05T07:53:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:14 smithi144 ceph-mon[29535]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 108 MiB/s wr, 44 op/s 2024-09-05T07:53:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:14 smithi175 ceph-mon[34585]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 108 MiB/s wr, 44 op/s 2024-09-05T07:53:15.796 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.796 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.796 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.796 INFO:tasks.workunit.client.0.smithi144.stdout:iozone test complete. 2024-09-05T07:53:15.798 INFO:tasks.workunit.client.0.smithi144.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-05T07:53:15.875 INFO:tasks.workunit.client.0.smithi144.stdout: Iozone: Performance Test of File I/O 2024-09-05T07:53:15.875 INFO:tasks.workunit.client.0.smithi144.stdout: Version $Revision: 3.494 $ 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Compiled for 64 bit mode. 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Build: linux-AMD64 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-05T07:53:15.876 INFO:tasks.workunit.client.0.smithi144.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Run began: Thu Sep 5 07:53:15 2024 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Include close in write timing 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Include fsync in write timing 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: File size set to 10485760 kB 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Record Size 1024 kB 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Output is in kBytes/sec 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Time Resolution = 0.000001 seconds. 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache size set to 1024 kBytes. 2024-09-05T07:53:15.877 INFO:tasks.workunit.client.0.smithi144.stdout: Processor cache line size set to 32 bytes. 2024-09-05T07:53:15.878 INFO:tasks.workunit.client.0.smithi144.stdout: File stride size set to 17 * record size. 2024-09-05T07:53:15.878 INFO:tasks.workunit.client.0.smithi144.stdout: Throughput test with 1 process 2024-09-05T07:53:15.878 INFO:tasks.workunit.client.0.smithi144.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-05T07:53:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:16 smithi175 ceph-mon[34585]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 78 MiB/s wr, 31 op/s 2024-09-05T07:53:16.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:16 smithi154 ceph-mon[34710]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 78 MiB/s wr, 31 op/s 2024-09-05T07:53:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:16 smithi144 ceph-mon[29535]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 78 MiB/s wr, 31 op/s 2024-09-05T07:53:18.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:18 smithi154 ceph-mon[34710]: pgmap v411: 97 pgs: 97 active+clean; 941 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 22 op/s 2024-09-05T07:53:18.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:18 smithi144 ceph-mon[29535]: pgmap v411: 97 pgs: 97 active+clean; 941 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 22 op/s 2024-09-05T07:53:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:18 smithi175 ceph-mon[34585]: pgmap v411: 97 pgs: 97 active+clean; 941 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 22 op/s 2024-09-05T07:53:20.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:20 smithi154 ceph-mon[34710]: pgmap v412: 97 pgs: 97 active+clean; 397 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-05T07:53:20.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:20 smithi144 ceph-mon[29535]: pgmap v412: 97 pgs: 97 active+clean; 397 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-05T07:53:20.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:20 smithi175 ceph-mon[34585]: pgmap v412: 97 pgs: 97 active+clean; 397 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 36 op/s 2024-09-05T07:53:22.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:22 smithi154 ceph-mon[34710]: pgmap v413: 97 pgs: 97 active+clean; 117 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 MiB/s wr, 37 op/s 2024-09-05T07:53:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:22 smithi144 ceph-mon[29535]: pgmap v413: 97 pgs: 97 active+clean; 117 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 MiB/s wr, 37 op/s 2024-09-05T07:53:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:22 smithi175 ceph-mon[34585]: pgmap v413: 97 pgs: 97 active+clean; 117 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 MiB/s wr, 37 op/s 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.664+0000 7fe269000640 1 -- 172.21.15.144:0/513371882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 msgr2=0x7fe264101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.664+0000 7fe269000640 1 --2- 172.21.15.144:0/513371882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264101a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe250009900 tx=0x7fe25002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 -- 172.21.15.144:0/513371882 shutdown_connections 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 --2- 172.21.15.144:0/513371882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe264109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 --2- 172.21.15.144:0/513371882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264101a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 --2- 172.21.15.144:0/513371882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe264103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 -- 172.21.15.144:0/513371882 >> 172.21.15.144:0/513371882 conn(0x7fe2640fd0d0 msgr2=0x7fe2640ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 -- 172.21.15.144:0/513371882 shutdown_connections 2024-09-05T07:53:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 -- 172.21.15.144:0/513371882 wait complete. 2024-09-05T07:53:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.665+0000 7fe269000640 1 Processor -- start 2024-09-05T07:53:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 -- start start 2024-09-05T07:53:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe26419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410d740 con 0x7fe264103050 2024-09-05T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410d5c0 con 0x7fe264101f40 2024-09-05T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe269000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410d8c0 con 0x7fe264101580 2024-09-05T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe263e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe262a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe26419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe263400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe263e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54246/0 (socket says 172.21.15.144:54246) 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe262a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe26419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43272/0 (socket says 172.21.15.144:43272) 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.666+0000 7fe263e00640 1 -- 172.21.15.144:0/1703534215 learned_addr learned my addr 172.21.15.144:0/1703534215 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 -- 172.21.15.144:0/1703534215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 msgr2=0x7fe264199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 -- 172.21.15.144:0/1703534215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 msgr2=0x7fe26419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe26419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 -- 172.21.15.144:0/1703534215 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2641a1c10 con 0x7fe264103050 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe263e00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00b5b0 tx=0x7fe25c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.667+0000 7fe25be00640 1 -- 172.21.15.144:0/1703534215 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c013070 con 0x7fe264103050 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.668+0000 7fe25be00640 1 -- 172.21.15.144:0/1703534215 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25c004d20 con 0x7fe264103050 2024-09-05T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.668+0000 7fe25be00640 1 -- 172.21.15.144:0/1703534215 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00fe40 con 0x7fe264103050 2024-09-05T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.668+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe264103fd0 con 0x7fe264103050 2024-09-05T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.668+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641044a0 con 0x7fe264103050 2024-09-05T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.671+0000 7fe26d3ff740 1 Processor -- start 2024-09-05T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.673+0000 7fe25be00640 1 -- 172.21.15.144:0/1703534215 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe25c014270 con 0x7fe264103050 2024-09-05T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.673+0000 7fe26d3ff740 1 -- start start 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b63660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b6b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555641ac8100 con 0x555641b63260 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555641a701b0 con 0x555641b63ba0 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.674+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555641ac40c0 con 0x555641b68c30 2024-09-05T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.675+0000 7fe263400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.675+0000 7fe263400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43280/0 (socket says 172.21.15.144:43280) 2024-09-05T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.675+0000 7fe263400640 1 -- 172.21.15.144:0/3563555611 learned_addr learned my addr 172.21.15.144:0/3563555611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.675+0000 7fe25be00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 0x7fe2480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.676+0000 7fe25be00640 1 -- 172.21.15.144:0/1703534215 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fe25c0cefc0 con 0x7fe264103050 2024-09-05T07:53:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 -- 172.21.15.144:0/3563555611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 msgr2=0x555641b6b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:53:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b6b0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 -- 172.21.15.144:0/3563555611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 msgr2=0x555641b63660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:53:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b63660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 -- 172.21.15.144:0/3563555611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556417db210 con 0x555641b63ba0 2024-09-05T07:53:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263e00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 0x7fe2480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.677+0000 7fe263400640 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe254009ca0 tx=0x7fe254011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e6269f904ae63fa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.678+0000 7fe258c00640 1 -- 172.21.15.144:0/3563555611 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254004220 con 0x555641b63ba0 2024-09-05T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.678+0000 7fe258c00640 1 -- 172.21.15.144:0/3563555611 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2540043c0 con 0x555641b63ba0 2024-09-05T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.678+0000 7fe258c00640 1 -- 172.21.15.144:0/3563555611 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254019930 con 0x555641b63ba0 2024-09-05T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.679+0000 7fe26d3ff740 1 -- 172.21.15.144:0/3563555611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 msgr2=0x555641b68660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.679+0000 7fe263e00640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 0x7fe2480a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe25c09b5a0 tx=0x7fe25c00bf70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.679+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe254009ca0 tx=0x7fe254011810 comp rx=0 tx=0).stop 2024-09-05T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.681+0000 7fe26d3ff740 1 -- 172.21.15.144:0/3563555611 shutdown_connections 2024-09-05T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.681+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b68660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.681+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b6b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.681+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/3563555611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b63660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.681+0000 7fe26d3ff740 1 -- 172.21.15.144:0/3563555611 >> 172.21.15.144:0/3563555611 conn(0x555641b5e8d0 msgr2=0x555641b5ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.682+0000 7fe26d3ff740 1 -- 172.21.15.144:0/3563555611 shutdown_connections 2024-09-05T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.682+0000 7fe26d3ff740 1 -- 172.21.15.144:0/3563555611 wait complete. 2024-09-05T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.683+0000 7fe26d3ff740 1 -- start start 2024-09-05T07:53:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.683+0000 7fe26d3ff740 1 Processor -- start 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 0x555641b6d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 0x555641b6d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b74a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555641b6bc00 con 0x555641b63ba0 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555641a51090 con 0x555641b63260 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555641b6bd80 con 0x555641b68c30 2024-09-05T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.684+0000 7fe26d3ff740 10 client.0 _ll_register_callbacks cb 0x555641aa5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.685+0000 7fe262a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 0x555641b6d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.685+0000 7fe262a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 0x555641b6d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43288/0 (socket says 172.21.15.144:43288) 2024-09-05T07:53:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.685+0000 7fe262a00640 1 -- 172.21.15.144:0/163083272 learned_addr learned my addr 172.21.15.144:0/163083272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.685+0000 7fe262a00640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b74a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:24 smithi154 ceph-mon[34710]: pgmap v414: 97 pgs: 97 active+clean; 565 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-05T07:53:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.686+0000 7fe263400640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 0x555641b6d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.687+0000 7fe263400640 1 -- 172.21.15.144:0/163083272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 msgr2=0x555641b74a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.687+0000 7fe263400640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b74a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.687+0000 7fe263400640 1 -- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 msgr2=0x555641b6d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.687+0000 7fe263400640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 0x555641b6d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.687+0000 7fe263400640 1 -- 172.21.15.144:0/163083272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556418a7620 con 0x555641b63ba0 2024-09-05T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.688+0000 7fe263400640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 0x555641b6d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe25401b040 tx=0x7fe254003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e43ddb21a44ac server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.688+0000 7fe24d600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.688+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254028070 con 0x555641b63ba0 2024-09-05T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.689+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fe25401f040 con 0x555641b63ba0 2024-09-05T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.689+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2540043c0 con 0x555641b63ba0 2024-09-05T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.689+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe254032050 con 0x555641b63ba0 2024-09-05T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.689+0000 7fe26d3ff740 10 client.15276 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.689+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555641b777f0 con 0x555641b63ba0 2024-09-05T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.690+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2540046c0 con 0x555641b63ba0 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe254005250 con 0x555641b63ba0 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 10 client.15276 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 10 client.15276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 20 client.15276 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641b78cb0 0x555641b7b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 4 client.15276 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.691+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe2540043c0 con 0x555641b78cb0 2024-09-05T07:53:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.692+0000 7fe262a00640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641b78cb0 0x555641b7b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.692+0000 7fe262a00640 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641b78cb0 0x555641b7b0a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b4274d262fee08e server_cookie=ae09c2194d292fe in_seq=0 out_seq=0 2024-09-05T07:53:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.692+0000 7fe24d600640 10 client.15276 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.693+0000 7fe24d600640 1 -- 172.21.15.144:0/163083272 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe2540043c0 con 0x555641b78cb0 2024-09-05T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.693+0000 7fe24d600640 10 client.15276 handle_command_reply: tid=0 2024-09-05T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.693+0000 7fe26d3ff740 1 client.15276 shutdown 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 msgr2=0x555641b6d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 0x555641b6d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe25401b040 tx=0x7fe254003b20 comp rx=0 tx=0).stop 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 shutdown_connections 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641b78cb0 0x555641b7b0a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641b74a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63ba0 0x555641b6d9c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/163083272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63260 0x555641b6d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 >> 172.21.15.144:0/163083272 conn(0x555641b5e8d0 msgr2=0x555641b600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe24d600640 0 client.15276 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 shutdown_connections 2024-09-05T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 1 -- 172.21.15.144:0/163083272 wait complete. 2024-09-05T07:53:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.694+0000 7fe26d3ff740 20 client.15276 trim_cache size 0 max 16384 2024-09-05T07:53:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 Processor -- start 2024-09-05T07:53:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 -- start start 2024-09-05T07:53:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b6c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 0x555641b5d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a6e40 con 0x555641b63260 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a8980 con 0x555641b68c30 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.725+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a7510 con 0x555641b63ba0 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:49076/0 (socket says 172.21.15.144:49076) 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 -- 172.21.15.144:0/1515491529 learned_addr learned my addr 172.21.15.144:0/1515491529 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe262a00640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b6c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe262a00640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 0x555641b5d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 -- 172.21.15.144:0/1515491529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 msgr2=0x555641b5d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 0x555641b5d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 -- 172.21.15.144:0/1515491529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 msgr2=0x555641b6c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b6c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 -- 172.21.15.144:0/1515491529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555641b5e6f0 con 0x555641b63ba0 2024-09-05T07:53:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe262a00640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 0x555641b5d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.726+0000 7fe263400640 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe254000c00 tx=0x7fe254005730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5203e437b2ed0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.727+0000 7fe24fe00640 1 -- 172.21.15.144:0/1515491529 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25403b020 con 0x555641b63ba0 2024-09-05T07:53:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.727+0000 7fe24fe00640 1 -- 172.21.15.144:0/1515491529 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254003b90 con 0x555641b63ba0 2024-09-05T07:53:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.727+0000 7fe24fe00640 1 -- 172.21.15.144:0/1515491529 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254028070 con 0x555641b63ba0 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.727+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1515491529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 msgr2=0x555641b749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.727+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe254000c00 tx=0x7fe254005730 comp rx=0 tx=0).stop 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1515491529 shutdown_connections 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b68c30 0x555641b5d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b63ba0 0x555641b749c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1515491529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b6c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1515491529 >> 172.21.15.144:0/1515491529 conn(0x555641b5e8d0 msgr2=0x555641b6c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1515491529 shutdown_connections 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1515491529 wait complete. 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.728+0000 7fe26d3ff740 1 -- start start 2024-09-05T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 Processor -- start 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641be1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a82b0 con 0x555641b63260 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a7be0 con 0x555641b63ba0 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2641a4e40 con 0x555641b68c30 2024-09-05T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.729+0000 7fe26d3ff740 10 client.0 _ll_register_callbacks cb 0x7fe254009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:43306/0 (socket says 172.21.15.144:43306) 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 -- 172.21.15.144:0/1649553095 learned_addr learned my addr 172.21.15.144:0/1649553095 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe262a00640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe262a00640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641be1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 -- 172.21.15.144:0/1649553095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 msgr2=0x555641be1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641be1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 -- 172.21.15.144:0/1649553095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 msgr2=0x555641b717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.730+0000 7fe263400640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe263400640 1 -- 172.21.15.144:0/1649553095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555641be1dd0 con 0x555641b63ba0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe262a00640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe263400640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe254005620 tx=0x7fe2540045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cede0ff96e87684 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe24d600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25403b040 con 0x555641b63ba0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fe254004960 con 0x555641b63ba0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.731+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe254003b90 con 0x555641b63ba0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe254028040 con 0x555641b63ba0 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 10 client.25286 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555641be2fc0 con 0x555641b63ba0 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254003b90 con 0x555641b63ba0 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe254047030 con 0x555641b63ba0 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 10 client.25286 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 10 client.25286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 20 client.25286 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641be38a0 0x555641be5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 4 client.25286 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.732+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555641ad5830 con 0x555641be38a0 2024-09-05T07:53:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.733+0000 7fe262a00640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641be38a0 0x555641be5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.733+0000 7fe262a00640 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641be38a0 0x555641be5cc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f58fcecf964823 server_cookie=5d141bac31fb707 in_seq=0 out_seq=0 2024-09-05T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.733+0000 7fe24d600640 10 client.25286 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.742+0000 7fe24d600640 1 -- 172.21.15.144:0/1649553095 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555641ad5830 con 0x555641be38a0 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.742+0000 7fe24d600640 10 client.25286 handle_command_reply: tid=0 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 client.25286 shutdown 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 msgr2=0x555641b71d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe254005620 tx=0x7fe2540045f0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 shutdown_connections 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x555641be38a0 0x555641be5cc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555641b63ba0 0x555641b71d30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe24d600640 0 client.25286 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.743+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555641b68c30 0x555641be1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.744+0000 7fe26d3ff740 1 --2- 172.21.15.144:0/1649553095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555641b63260 0x555641b717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.744+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 >> 172.21.15.144:0/1649553095 conn(0x555641b5e8d0 msgr2=0x555641b5f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.744+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 shutdown_connections 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.744+0000 7fe26d3ff740 1 -- 172.21.15.144:0/1649553095 wait complete. 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.744+0000 7fe26d3ff740 20 client.25286 trim_cache size 0 max 16384 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:53:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.745+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 msgr2=0x7fe2480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.745+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 0x7fe2480a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe25c09b5a0 tx=0x7fe25c00bf70 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.745+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 msgr2=0x7fe2641a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.745+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00b5b0 tx=0x7fe25c00ba70 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 shutdown_connections 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fe2480a2c00 0x7fe2480a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264101f40 0x7fe26419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe264103050 0x7fe2641a15a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 --2- 172.21.15.144:0/1703534215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe264101580 0x7fe264199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 >> 172.21.15.144:0/1703534215 conn(0x7fe2640fd0d0 msgr2=0x7fe264108380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 shutdown_connections 2024-09-05T07:53:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:24.746+0000 7fe269000640 1 -- 172.21.15.144:0/1703534215 wait complete. 2024-09-05T07:53:24.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:24 smithi144 ceph-mon[29535]: pgmap v414: 97 pgs: 97 active+clean; 565 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-05T07:53:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:24 smithi175 ceph-mon[34585]: pgmap v414: 97 pgs: 97 active+clean; 565 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-05T07:53:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:26 smithi154 ceph-mon[34710]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 129 MiB/s wr, 67 op/s 2024-09-05T07:53:26.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:26 smithi144 ceph-mon[29535]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 129 MiB/s wr, 67 op/s 2024-09-05T07:53:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:26 smithi175 ceph-mon[34585]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 129 MiB/s wr, 67 op/s 2024-09-05T07:53:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:28 smithi154 ceph-mon[34710]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 141 MiB/s wr, 70 op/s 2024-09-05T07:53:28.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:28 smithi144 ceph-mon[29535]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 141 MiB/s wr, 70 op/s 2024-09-05T07:53:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:28 smithi175 ceph-mon[34585]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 141 MiB/s wr, 70 op/s 2024-09-05T07:53:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:30 smithi154 ceph-mon[34710]: pgmap v417: 97 pgs: 97 active+clean; 2.5 GiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 212 MiB/s wr, 91 op/s 2024-09-05T07:53:30.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:30 smithi144 ceph-mon[29535]: pgmap v417: 97 pgs: 97 active+clean; 2.5 GiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 212 MiB/s wr, 91 op/s 2024-09-05T07:53:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:30 smithi175 ceph-mon[34585]: pgmap v417: 97 pgs: 97 active+clean; 2.5 GiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 212 MiB/s wr, 91 op/s 2024-09-05T07:53:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:32 smithi154 ceph-mon[34710]: pgmap v418: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 271 MiB/s wr, 91 op/s 2024-09-05T07:53:32.826 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:32 smithi144 ceph-mon[29535]: pgmap v418: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 271 MiB/s wr, 91 op/s 2024-09-05T07:53:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:32 smithi175 ceph-mon[34585]: pgmap v418: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 271 MiB/s wr, 91 op/s 2024-09-05T07:53:33.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:33 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:53:33.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:33 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:53:33.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:33 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:53:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:34 smithi154 ceph-mon[34710]: pgmap v419: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 316 MiB/s wr, 98 op/s 2024-09-05T07:53:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:53:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:53:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:53:34.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:34 smithi144 ceph-mon[29535]: pgmap v419: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 316 MiB/s wr, 98 op/s 2024-09-05T07:53:34.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:53:34.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:53:34.825 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:53:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:34 smithi175 ceph-mon[34585]: pgmap v419: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 316 MiB/s wr, 98 op/s 2024-09-05T07:53:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:53:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:53:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:53:36.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:36 smithi144 ceph-mon[29535]: pgmap v420: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 360 MiB/s wr, 105 op/s 2024-09-05T07:53:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:36 smithi175 ceph-mon[34585]: pgmap v420: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 360 MiB/s wr, 105 op/s 2024-09-05T07:53:36.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:36 smithi154 ceph-mon[34710]: pgmap v420: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 360 MiB/s wr, 105 op/s 2024-09-05T07:53:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 -- 172.21.15.144:0/2257555456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c104f60 msgr2=0x7f816c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 --2- 172.21.15.144:0/2257555456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c104f60 0x7f816c1053e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8158009900 tx=0x7f815802a400 comp rx=0 tx=0).stop 2024-09-05T07:53:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 -- 172.21.15.144:0/2257555456 shutdown_connections 2024-09-05T07:53:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 --2- 172.21.15.144:0/2257555456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c104f60 0x7f816c1053e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 --2- 172.21.15.144:0/2257555456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c105920 0x7f816c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 --2- 172.21.15.144:0/2257555456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c103d70 0x7f816c104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.924+0000 7f8172000640 1 -- 172.21.15.144:0/2257555456 >> 172.21.15.144:0/2257555456 conn(0x7f816c0ff4d0 msgr2=0x7f816c101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.925+0000 7f8172000640 1 -- 172.21.15.144:0/2257555456 shutdown_connections 2024-09-05T07:53:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.926+0000 7f8172000640 1 -- 172.21.15.144:0/2257555456 wait complete. 2024-09-05T07:53:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.927+0000 7f8172000640 1 Processor -- start 2024-09-05T07:53:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.927+0000 7f8172000640 1 -- start start 2024-09-05T07:53:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 0x7f816c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c105920 0x7f816c1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f816c10fa20 con 0x7f816c104f60 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f816c10f8a0 con 0x7f816c105920 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.928+0000 7f8172000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f816c10fba0 con 0x7f816c103d70 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 0x7f816c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46652/0 (socket says 172.21.15.144:46652) 2024-09-05T07:53:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816b400640 1 -- 172.21.15.144:0/794473020 learned_addr learned my addr 172.21.15.144:0/794473020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816be00640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c105920 0x7f816c1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.929+0000 7f816aa00640 1 -- 172.21.15.144:0/794473020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 msgr2=0x7f816c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816aa00640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816aa00640 1 -- 172.21.15.144:0/794473020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c105920 msgr2=0x7f816c1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816aa00640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c105920 0x7f816c1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816aa00640 1 -- 172.21.15.144:0/794473020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c1a1bd0 con 0x7f816c104f60 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816b400640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.930+0000 7f816aa00640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 0x7f816c19a4f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f815802a920 tx=0x7f8158032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.931+0000 7f8163e00640 1 -- 172.21.15.144:0/794473020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815803f030 con 0x7f816c104f60 2024-09-05T07:53:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.931+0000 7f8163e00640 1 -- 172.21.15.144:0/794473020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8158003ce0 con 0x7f816c104f60 2024-09-05T07:53:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.931+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c1a1e60 con 0x7f816c104f60 2024-09-05T07:53:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.931+0000 7f8163e00640 1 -- 172.21.15.144:0/794473020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158035070 con 0x7f816c104f60 2024-09-05T07:53:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.931+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c1a22d0 con 0x7f816c104f60 2024-09-05T07:53:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.935+0000 7f817503c740 1 Processor -- start 2024-09-05T07:53:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.935+0000 7f817503c740 1 -- start start 2024-09-05T07:53:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 0x55d26e6abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d26e603100 con 0x55d26e6a68a0 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d26e5ab1b0 con 0x55d26e6a71e0 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f817503c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d26e5ff0c0 con 0x55d26e6ac270 2024-09-05T07:53:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f8163e00640 1 -- 172.21.15.144:0/794473020 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8158042030 con 0x7f816c104f60 2024-09-05T07:53:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f816be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f816be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44364/0 (socket says 172.21.15.144:44364) 2024-09-05T07:53:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f816be00640 1 -- 172.21.15.144:0/885924247 learned_addr learned my addr 172.21.15.144:0/885924247 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.936+0000 7f816b400640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 0x55d26e6abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 -- 172.21.15.144:0/885924247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 msgr2=0x55d26e6ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816aa00640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 -- 172.21.15.144:0/885924247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 msgr2=0x55d26e6abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 0x55d26e6abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 -- 172.21.15.144:0/885924247 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26e316210 con 0x55d26e6a68a0 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816b400640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 0x55d26e6abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.937+0000 7f816be00640 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8164010370 tx=0x7f8164010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad74e5fef5824ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f8163e00640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 0x7f81500a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f8163e00640 1 -- 172.21.15.144:0/794473020 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f81580ef560 con 0x7f816c104f60 2024-09-05T07:53:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f816b400640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 0x7f81500a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f8157e00640 1 -- 172.21.15.144:0/885924247 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164016070 con 0x55d26e6a68a0 2024-09-05T07:53:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f8157e00640 1 -- 172.21.15.144:0/885924247 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8164004d20 con 0x55d26e6a68a0 2024-09-05T07:53:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.938+0000 7f8157e00640 1 -- 172.21.15.144:0/885924247 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164005480 con 0x55d26e6a68a0 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.939+0000 7f817503c740 1 -- 172.21.15.144:0/885924247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 msgr2=0x55d26e6a6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.939+0000 7f817503c740 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8164010370 tx=0x7f8164010830 comp rx=0 tx=0).stop 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.939+0000 7f816b400640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 0x7f81500a51f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d26e6a7c10 tx=0x7f815c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 -- 172.21.15.144:0/885924247 shutdown_connections 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a71e0 0x55d26e6abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 --2- 172.21.15.144:0/885924247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6a6ca0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 -- 172.21.15.144:0/885924247 >> 172.21.15.144:0/885924247 conn(0x55d26e6a1f10 msgr2=0x55d26e6a2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 -- 172.21.15.144:0/885924247 shutdown_connections 2024-09-05T07:53:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.940+0000 7f817503c740 1 -- 172.21.15.144:0/885924247 wait complete. 2024-09-05T07:53:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.941+0000 7f817503c740 1 -- start start 2024-09-05T07:53:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.941+0000 7f817503c740 1 Processor -- start 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a68a0 0x55d26e6b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6b8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d26e6af240 con 0x55d26e6a71e0 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d26e58c090 con 0x55d26e6a68a0 2024-09-05T07:53:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.944+0000 7f817503c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d26e6af3c0 con 0x55d26e6ac270 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f817503c740 10 client.0 _ll_register_callbacks cb 0x55d26e5e0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44378/0 (socket says 172.21.15.144:44378) 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816aa00640 1 -- 172.21.15.144:0/2798115089 learned_addr learned my addr 172.21.15.144:0/2798115089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816be00640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816b400640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a68a0 0x55d26e6b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.945+0000 7f816aa00640 1 -- 172.21.15.144:0/2798115089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 msgr2=0x55d26e6b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.946+0000 7f816aa00640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.946+0000 7f816aa00640 1 -- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a68a0 msgr2=0x55d26e6b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.946+0000 7f816aa00640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a68a0 0x55d26e6b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.946+0000 7f816aa00640 1 -- 172.21.15.144:0/2798115089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26e3e2620 con 0x55d26e6a71e0 2024-09-05T07:53:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.946+0000 7f816aa00640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81580b81b0 tx=0x7f81580bbb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5f22e7a05de56e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.947+0000 7f8154c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.947+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580bc450 con 0x55d26e6a71e0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.947+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f81580b83c0 con 0x55d26e6a71e0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.947+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8164004d20 con 0x55d26e6a71e0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.947+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f81580bbd50 con 0x55d26e6a71e0 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 10 client.15294 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d26e6bae50 con 0x55d26e6a71e0 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8164004d20 con 0x55d26e6a71e0 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f81580c4530 con 0x55d26e6a71e0 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 10 client.15294 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 20 client.15294 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e6bc510 0x55d26e6be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 4 client.15294 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.948+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d26e610830 con 0x55d26e6bc510 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.949+0000 7f816b400640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e6bc510 0x55d26e6be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.949+0000 7f816b400640 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e6bc510 0x55d26e6be950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0edfc5acd22371 server_cookie=279ca5d51c249a80 in_seq=0 out_seq=0 2024-09-05T07:53:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.949+0000 7f8154c00640 10 client.15294 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.950+0000 7f8154c00640 1 -- 172.21.15.144:0/2798115089 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d26e610830 con 0x55d26e6bc510 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.950+0000 7f8154c00640 10 client.15294 handle_command_reply: tid=0 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.950+0000 7f817503c740 1 client.15294 shutdown 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.950+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 msgr2=0x55d26e6b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.950+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81580b81b0 tx=0x7f81580bbb20 comp rx=0 tx=0).stop 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 shutdown_connections 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e6bc510 0x55d26e6be950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6ac270 0x55d26e6b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b1020 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 --2- 172.21.15.144:0/2798115089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6a68a0 0x55d26e6b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 >> 172.21.15.144:0/2798115089 conn(0x55d26e6a1f10 msgr2=0x55d26e6a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f8154c00640 0 client.15294 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 shutdown_connections 2024-09-05T07:53:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 1 -- 172.21.15.144:0/2798115089 wait complete. 2024-09-05T07:53:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.951+0000 7f817503c740 20 client.15294 trim_cache size 0 max 16384 2024-09-05T07:53:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 Processor -- start 2024-09-05T07:53:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 -- start start 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a71e0 0x55d26e6b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a6eb0 con 0x55d26e6a68a0 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a89f0 con 0x55d26e6ac270 2024-09-05T07:53:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f817503c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a7580 con 0x55d26e6a71e0 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f816b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f816be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f816be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:34696/0 (socket says 172.21.15.144:34696) 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f816be00640 1 -- 172.21.15.144:0/2829924963 learned_addr learned my addr 172.21.15.144:0/2829924963 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.972+0000 7f816aa00640 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a71e0 0x55d26e6b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 -- 172.21.15.144:0/2829924963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a71e0 msgr2=0x55d26e6b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a71e0 0x55d26e6b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 -- 172.21.15.144:0/2829924963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 msgr2=0x55d26e6948d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6948d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 -- 172.21.15.144:0/2829924963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26e6a76c0 con 0x55d26e6ac270 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f816be00640 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8164000f80 tx=0x7f8164009d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cec582e2d736364 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.973+0000 7f8157400640 1 -- 172.21.15.144:0/2829924963 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164029070 con 0x55d26e6ac270 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f8157400640 1 -- 172.21.15.144:0/2829924963 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81640050c0 con 0x55d26e6ac270 2024-09-05T07:53:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f8157400640 1 -- 172.21.15.144:0/2829924963 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164016040 con 0x55d26e6ac270 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 -- 172.21.15.144:0/2829924963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 msgr2=0x55d26e6a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8164000f80 tx=0x7f8164009d40 comp rx=0 tx=0).stop 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 -- 172.21.15.144:0/2829924963 shutdown_connections 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6a8420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a71e0 0x55d26e6b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 --2- 172.21.15.144:0/2829924963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a68a0 0x55d26e6948d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.974+0000 7f817503c740 1 -- 172.21.15.144:0/2829924963 >> 172.21.15.144:0/2829924963 conn(0x55d26e6a1f10 msgr2=0x55d26e6afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.975+0000 7f817503c740 1 -- 172.21.15.144:0/2829924963 shutdown_connections 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.975+0000 7f817503c740 1 -- 172.21.15.144:0/2829924963 wait complete. 2024-09-05T07:53:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.975+0000 7f817503c740 1 -- start start 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.975+0000 7f817503c740 1 Processor -- start 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a8320 con 0x55d26e6a71e0 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a7c50 con 0x55d26e6ac270 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1a4e90 con 0x55d26e6a68a0 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f817503c740 10 client.0 _ll_register_callbacks cb 0x7f81580b78d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46676/0 (socket says 172.21.15.144:46676) 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 -- 172.21.15.144:0/2980962035 learned_addr learned my addr 172.21.15.144:0/2980962035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816aa00640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.979 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 -- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 msgr2=0x55d26e6b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.979 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 -- 172.21.15.144:0/2980962035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 msgr2=0x55d26e6b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816b400640 1 -- 172.21.15.144:0/2980962035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26e6b6ba0 con 0x55d26e6a68a0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816aa00640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.976+0000 7f816be00640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f816b400640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f815c011600 tx=0x7f815c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cca945b6c79decac server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f8154c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c01c900 con 0x55d26e6a68a0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81640050c0 con 0x55d26e6a68a0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f815c01caa0 con 0x55d26e6a68a0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f815c01cca0 con 0x55d26e6a68a0 2024-09-05T07:53:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f817503c740 10 client.25303 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.977+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d26e6b7f80 con 0x55d26e6a68a0 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81640050c0 con 0x55d26e6a68a0 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f815c00f550 con 0x55d26e6a68a0 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 10 client.25303 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 10 client.25303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 20 client.25303 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e727640 0x55d26e729a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 4 client.25303 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d26e60ab80 con 0x55d26e727640 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.978+0000 7f816aa00640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e727640 0x55d26e729a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.979+0000 7f816aa00640 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e727640 0x55d26e729a60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e82d27863c0f37 server_cookie=7d1cae35d771c630 in_seq=0 out_seq=0 2024-09-05T07:53:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.979+0000 7f8154c00640 10 client.25303 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f8154c00640 1 -- 172.21.15.144:0/2980962035 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d26e60ab80 con 0x55d26e727640 2024-09-05T07:53:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f8154c00640 10 client.25303 handle_command_reply: tid=0 2024-09-05T07:53:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 client.25303 shutdown 2024-09-05T07:53:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 msgr2=0x55d26e6b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f815c011600 tx=0x7f815c004730 comp rx=0 tx=0).stop 2024-09-05T07:53:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 shutdown_connections 2024-09-05T07:53:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55d26e727640 0x55d26e729a60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f8154c00640 0 client.25303 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d26e6ac270 0x55d26e6b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d26e6a71e0 0x55d26e6b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 --2- 172.21.15.144:0/2980962035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d26e6a68a0 0x55d26e6b5090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 >> 172.21.15.144:0/2980962035 conn(0x55d26e6a1f10 msgr2=0x55d26e6b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 shutdown_connections 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.989+0000 7f817503c740 1 -- 172.21.15.144:0/2980962035 wait complete. 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f817503c740 20 client.25303 trim_cache size 0 max 16384 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:53:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 msgr2=0x7f81500a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 0x7f81500a51f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d26e6a7c10 tx=0x7f815c00b410 comp rx=0 tx=0).stop 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 msgr2=0x7f816c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 0x7f816c19a4f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f815802a920 tx=0x7f8158032e20 comp rx=0 tx=0).stop 2024-09-05T07:53:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 shutdown_connections 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f81500a2d30 0x7f81500a51f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f816c105920 0x7f816c1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c104f60 0x7f816c19a4f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 --2- 172.21.15.144:0/794473020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f816c103d70 0x7f816c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.990+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 >> 172.21.15.144:0/794473020 conn(0x7f816c0ff4d0 msgr2=0x7f816c108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.991+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 shutdown_connections 2024-09-05T07:53:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:37.991+0000 7f8172000640 1 -- 172.21.15.144:0/794473020 wait complete. 2024-09-05T07:53:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:38 smithi144 ceph-mon[29535]: pgmap v421: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 290 MiB/s wr, 87 op/s 2024-09-05T07:53:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:38 smithi175 ceph-mon[34585]: pgmap v421: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 290 MiB/s wr, 87 op/s 2024-09-05T07:53:38.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:38 smithi154 ceph-mon[34710]: pgmap v421: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 290 MiB/s wr, 87 op/s 2024-09-05T07:53:40.823 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:40 smithi144 ceph-mon[29535]: pgmap v422: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 359 MiB/s wr, 107 op/s 2024-09-05T07:53:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:40 smithi175 ceph-mon[34585]: pgmap v422: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 359 MiB/s wr, 107 op/s 2024-09-05T07:53:40.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:40 smithi154 ceph-mon[34710]: pgmap v422: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 359 MiB/s wr, 107 op/s 2024-09-05T07:53:42.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:42 smithi144 ceph-mon[29535]: pgmap v423: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 351 MiB/s wr, 100 op/s 2024-09-05T07:53:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:42 smithi175 ceph-mon[34585]: pgmap v423: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 351 MiB/s wr, 100 op/s 2024-09-05T07:53:42.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:42 smithi154 ceph-mon[34710]: pgmap v423: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 351 MiB/s wr, 100 op/s 2024-09-05T07:53:44.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:44 smithi144 ceph-mon[29535]: pgmap v424: 97 pgs: 97 active+clean; 7.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 348 MiB/s wr, 103 op/s 2024-09-05T07:53:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:44 smithi175 ceph-mon[34585]: pgmap v424: 97 pgs: 97 active+clean; 7.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 348 MiB/s wr, 103 op/s 2024-09-05T07:53:44.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:44 smithi154 ceph-mon[34710]: pgmap v424: 97 pgs: 97 active+clean; 7.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 348 MiB/s wr, 103 op/s 2024-09-05T07:53:46.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:46 smithi144 ceph-mon[29535]: pgmap v425: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 392 MiB/s wr, 110 op/s 2024-09-05T07:53:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:46 smithi175 ceph-mon[34585]: pgmap v425: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 392 MiB/s wr, 110 op/s 2024-09-05T07:53:46.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:46 smithi154 ceph-mon[34710]: pgmap v425: 97 pgs: 97 active+clean; 8.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 392 MiB/s wr, 110 op/s 2024-09-05T07:53:47.704 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:53:47.704 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 initial writers = 329801.19 kB/sec 2024-09-05T07:53:47.704 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 initial writers = 329794.73 kB/sec 2024-09-05T07:53:47.704 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 329801.19 kB/sec 2024-09-05T07:53:47.705 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 329801.19 kB/sec 2024-09-05T07:53:47.705 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 329801.19 kB/sec 2024-09-05T07:53:47.705 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 10485760.00 kB 2024-09-05T07:53:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:48 smithi144 ceph-mon[29535]: pgmap v426: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 327 MiB/s wr, 94 op/s 2024-09-05T07:53:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:48 smithi175 ceph-mon[34585]: pgmap v426: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 327 MiB/s wr, 94 op/s 2024-09-05T07:53:48.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:48 smithi154 ceph-mon[34710]: pgmap v426: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 327 MiB/s wr, 94 op/s 2024-09-05T07:53:50.740 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:50 smithi154 ceph-mon[34710]: pgmap v427: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 403 MiB/s wr, 115 op/s 2024-09-05T07:53:50.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:50 smithi144 ceph-mon[29535]: pgmap v427: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 403 MiB/s wr, 115 op/s 2024-09-05T07:53:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:50 smithi175 ceph-mon[34585]: pgmap v427: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 403 MiB/s wr, 115 op/s 2024-09-05T07:53:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 -- 172.21.15.144:0/3669132023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 msgr2=0x7f233c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 --2- 172.21.15.144:0/3669132023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c10be90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2334009be0 tx=0x7f233402a6c0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 -- 172.21.15.144:0/3669132023 shutdown_connections 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 --2- 172.21.15.144:0/3669132023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c10be90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 --2- 172.21.15.144:0/3669132023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 0x7f233c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 --2- 172.21.15.144:0/3669132023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 -- 172.21.15.144:0/3669132023 >> 172.21.15.144:0/3669132023 conn(0x7f233c0fd2e0 msgr2=0x7f233c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 -- 172.21.15.144:0/3669132023 shutdown_connections 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.112+0000 7f2343800640 1 -- 172.21.15.144:0/3669132023 wait complete. 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.113+0000 7f2343800640 1 Processor -- start 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.113+0000 7f2343800640 1 -- start start 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 0x7f233c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c1a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f233c10f9b0 con 0x7f233c076230 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f233c10f830 con 0x7f233c1099d0 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2343800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c10fb30 con 0x7f233c074c50 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f233be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f233be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50846/0 (socket says 172.21.15.144:50846) 2024-09-05T07:53:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f233be00640 1 -- 172.21.15.144:0/3723294535 learned_addr learned my addr 172.21.15.144:0/3723294535 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2340e00640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 0x7f233c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.114+0000 7f2341800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c1a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 -- 172.21.15.144:0/3723294535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 msgr2=0x7f233c199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 0x7f233c199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 -- 172.21.15.144:0/3723294535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 msgr2=0x7f233c1a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c1a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 -- 172.21.15.144:0/3723294535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233c1a1ba0 con 0x7f233c076230 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f233be00640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9f0 tx=0x7f232800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f2339600640 1 -- 172.21.15.144:0/3723294535 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232800ccc0 con 0x7f233c076230 2024-09-05T07:53:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f2339600640 1 -- 172.21.15.144:0/3723294535 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2328010910 con 0x7f233c076230 2024-09-05T07:53:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233c1a1e90 con 0x7f233c076230 2024-09-05T07:53:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f2339600640 1 -- 172.21.15.144:0/3723294535 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280188a0 con 0x7f233c076230 2024-09-05T07:53:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.115+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233c1a2350 con 0x7f233c076230 2024-09-05T07:53:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 Processor -- start 2024-09-05T07:53:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 -- start start 2024-09-05T07:53:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f2339600640 1 -- 172.21.15.144:0/3723294535 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2328018a40 con 0x7f233c076230 2024-09-05T07:53:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e796490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e79df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56352e6fb100 con 0x56352e79ba60 2024-09-05T07:53:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56352e6a31b0 con 0x56352e796090 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.119+0000 7f23467cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56352e6f70c0 con 0x56352e7969d0 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f233be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e79df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2341800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e796490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:38732/0 (socket says 172.21.15.144:38732) 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 -- 172.21.15.144:0/692128477 learned_addr learned my addr 172.21.15.144:0/692128477 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 -- 172.21.15.144:0/692128477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 msgr2=0x56352e796490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e796490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 -- 172.21.15.144:0/692128477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 msgr2=0x56352e79df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e79df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.120+0000 7f2340e00640 1 -- 172.21.15.144:0/692128477 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352e40e210 con 0x56352e7969d0 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f2340e00640 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2330009cd0 tx=0x7f2330011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbfde6fc84c09bb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f2339600640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 0x7f23240a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f2339600640 1 -- 172.21.15.144:0/3723294535 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f23280cf540 con 0x7f233c076230 2024-09-05T07:53:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f232e000640 1 -- 172.21.15.144:0/692128477 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233001e070 con 0x56352e7969d0 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f232e000640 1 -- 172.21.15.144:0/692128477 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2330019b10 con 0x56352e7969d0 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f232e000640 1 -- 172.21.15.144:0/692128477 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233000eaf0 con 0x56352e7969d0 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.121+0000 7f2341800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 0x7f23240a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- 172.21.15.144:0/692128477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 msgr2=0x56352e79b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2330009cd0 tx=0x7f2330011810 comp rx=0 tx=0).stop 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f2341800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 0x7f23240a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f233402abe0 tx=0x7f2334005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- 172.21.15.144:0/692128477 shutdown_connections 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e79df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e79b490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 --2- 172.21.15.144:0/692128477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e796490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- 172.21.15.144:0/692128477 >> 172.21.15.144:0/692128477 conn(0x56352e791700 msgr2=0x56352e791b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- 172.21.15.144:0/692128477 shutdown_connections 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- 172.21.15.144:0/692128477 wait complete. 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.122+0000 7f23467cc740 1 -- start start 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 Processor -- start 2024-09-05T07:53:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 0x56352e7a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e79ba60 0x56352e7a7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56352e79ea30 con 0x56352e7969d0 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56352e684090 con 0x56352e79ba60 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56352e79ebb0 con 0x56352e796090 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f23467cc740 10 client.0 _ll_register_callbacks cb 0x56352e6d8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f233be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 0x56352e7a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f2340e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f233be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 0x56352e7a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50854/0 (socket says 172.21.15.144:50854) 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f233be00640 1 -- 172.21.15.144:0/1186021084 learned_addr learned my addr 172.21.15.144:0/1186021084 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f2340e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:38740/0 (socket says 172.21.15.144:38740) 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.123+0000 7f2341800640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e79ba60 0x56352e7a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 -- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e79ba60 msgr2=0x56352e7a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e79ba60 0x56352e7a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 -- 172.21.15.144:0/1186021084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 msgr2=0x56352e7a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 0x56352e7a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 -- 172.21.15.144:0/1186021084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352e4da620 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2340e00640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f233001c040 tx=0x7f2330009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b899751e634d40dc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2322a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330029020 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2330019b10 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.124+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f2330019cc0 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2330034050 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 10 client.25315 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56352e7aa5d0 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2330019b10 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f233000ec60 con 0x56352e796090 2024-09-05T07:53:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 10 client.25315 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 10 client.25315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 20 client.25315 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e7abaf0 0x56352e7adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 4 client.25315 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.125+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56352e708830 con 0x56352e7abaf0 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.126+0000 7f233be00640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e7abaf0 0x56352e7adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.126+0000 7f233be00640 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e7abaf0 0x56352e7adee0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccae457ad7f168ff server_cookie=2b4a2e81f93ea748 in_seq=0 out_seq=0 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.126+0000 7f2322a00640 10 client.25315 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f2322a00640 1 -- 172.21.15.144:0/1186021084 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56352e708830 con 0x56352e7abaf0 2024-09-05T07:53:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f2322a00640 10 client.25315 handle_command_reply: tid=0 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 client.25315 shutdown 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 msgr2=0x56352e7a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f233001c040 tx=0x7f2330009f40 comp rx=0 tx=0).stop 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 shutdown_connections 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e7abaf0 0x56352e7adee0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e79ba60 0x56352e7a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e7969d0 0x56352e7a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f2322a00640 0 client.25315 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 --2- 172.21.15.144:0/1186021084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a0280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.127+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 >> 172.21.15.144:0/1186021084 conn(0x56352e791700 msgr2=0x56352e792f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.128+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 shutdown_connections 2024-09-05T07:53:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.128+0000 7f23467cc740 1 -- 172.21.15.144:0/1186021084 wait complete. 2024-09-05T07:53:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.128+0000 7f23467cc740 20 client.25315 trim_cache size 0 max 16384 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 Processor -- start 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 -- start start 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 0x56352e7a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e790770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ab1e0 con 0x56352e79ba60 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1acd20 con 0x56352e7969d0 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.143+0000 7f23467cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ab8b0 con 0x56352e796090 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f2341800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e790770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 0x56352e7a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f2341800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e790770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50858/0 (socket says 172.21.15.144:50858) 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f2341800640 1 -- 172.21.15.144:0/1610332171 learned_addr learned my addr 172.21.15.144:0/1610332171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f2340e00640 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 -- 172.21.15.144:0/1610332171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 msgr2=0x56352e7a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 -- 172.21.15.144:0/1610332171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 msgr2=0x56352e790770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e790770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 -- 172.21.15.144:0/1610332171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352e79e910 con 0x56352e7969d0 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f233be00640 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 0x56352e7a7750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23280a4470 tx=0x7f23280d4040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bcdcb74789a1d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f232d600640 1 -- 172.21.15.144:0/1610332171 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232809c430 con 0x56352e7969d0 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f232d600640 1 -- 172.21.15.144:0/1610332171 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f232809bd30 con 0x56352e7969d0 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.144+0000 7f232d600640 1 -- 172.21.15.144:0/1610332171 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328010ac0 con 0x56352e7969d0 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 -- 172.21.15.144:0/1610332171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 msgr2=0x56352e7a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 0x56352e7a7750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23280a4470 tx=0x7f23280d4040 comp rx=0 tx=0).stop 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 -- 172.21.15.144:0/1610332171 shutdown_connections 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e7969d0 0x56352e7a7750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e790770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 --2- 172.21.15.144:0/1610332171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e796090 0x56352e7a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 -- 172.21.15.144:0/1610332171 >> 172.21.15.144:0/1610332171 conn(0x56352e791700 msgr2=0x56352e790060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 -- 172.21.15.144:0/1610332171 shutdown_connections 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.145+0000 7f23467cc740 1 -- 172.21.15.144:0/1610332171 wait complete. 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 -- start start 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 Processor -- start 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e7a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e7a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ac650 con 0x56352e79ba60 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1abf80 con 0x56352e796090 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1a91c0 con 0x56352e7969d0 2024-09-05T07:53:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.146+0000 7f23467cc740 10 client.0 _ll_register_callbacks cb 0x7f233001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:38756/0 (socket says 172.21.15.144:38756) 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 -- 172.21.15.144:0/710833912 learned_addr learned my addr 172.21.15.144:0/710833912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f2341800640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e7a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f2340e00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e7a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 -- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 msgr2=0x56352e7a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e7a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 -- 172.21.15.144:0/710833912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 msgr2=0x56352e7a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e7a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 -- 172.21.15.144:0/710833912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352e7a6680 con 0x56352e7969d0 2024-09-05T07:53:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f233be00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0615fcd302e49f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f2322a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b8070 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f2328010ac0 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.147+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f232809bd30 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f232809c430 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 10 client.25321 fetch_fsmap learned FSMap version 29 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56352e7a7a00 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f232809bd30 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f232809b180 con 0x56352e7969d0 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 10 client.25321 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 10 client.25321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 20 client.25321 populate_metadata read hostname 'smithi144' 2024-09-05T07:53:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e816e10 0x56352e819230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:53:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 4 client.25321 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:53:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56352e702b80 con 0x56352e816e10 2024-09-05T07:53:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.148+0000 7f2340e00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e816e10 0x56352e819230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:53:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.149+0000 7f2340e00640 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e816e10 0x56352e819230 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaec5dbddc4f1608 server_cookie=c97c326acbb67172 in_seq=0 out_seq=0 2024-09-05T07:53:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.149+0000 7f2322a00640 10 client.25321 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f2322a00640 1 -- 172.21.15.144:0/710833912 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56352e702b80 con 0x56352e816e10 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f2322a00640 10 client.25321 handle_command_reply: tid=0 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 client.25321 shutdown 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 msgr2=0x56352e7a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280097a0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 shutdown_connections 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x56352e816e10 0x56352e819230 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56352e79ba60 0x56352e7a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e7969d0 0x56352e7a5060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 --2- 172.21.15.144:0/710833912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56352e796090 0x56352e7a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f2322a00640 0 client.25321 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 >> 172.21.15.144:0/710833912 conn(0x56352e791700 msgr2=0x56352e790880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 shutdown_connections 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.159+0000 7f23467cc740 1 -- 172.21.15.144:0/710833912 wait complete. 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f23467cc740 20 client.25321 trim_cache size 0 max 16384 2024-09-05T07:53:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 msgr2=0x7f23240a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 0x7f23240a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f233402abe0 tx=0x7f2334005fd0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 msgr2=0x7f233c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:53:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9f0 tx=0x7f232800edf0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 shutdown_connections 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f23240a2c30 0x7f23240a50f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f233c1099d0 0x7f233c1a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f233c076230 0x7f233c19a4c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 --2- 172.21.15.144:0/3723294535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c074c50 0x7f233c199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.160+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 >> 172.21.15.144:0/3723294535 conn(0x7f233c0fd2e0 msgr2=0x7f233c105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.161+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 shutdown_connections 2024-09-05T07:53:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:53:51.161+0000 7f2343800640 1 -- 172.21.15.144:0/3723294535 wait complete. 2024-09-05T07:53:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:52 smithi144 ceph-mon[29535]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 MiB/s wr, 99 op/s 2024-09-05T07:53:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:52 smithi175 ceph-mon[34585]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 MiB/s wr, 99 op/s 2024-09-05T07:53:52.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:52 smithi154 ceph-mon[34710]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 MiB/s wr, 99 op/s 2024-09-05T07:53:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:54 smithi144 ceph-mon[29535]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 305 MiB/s wr, 92 op/s 2024-09-05T07:53:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:54 smithi175 ceph-mon[34585]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 305 MiB/s wr, 92 op/s 2024-09-05T07:53:54.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:54 smithi154 ceph-mon[34710]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 305 MiB/s wr, 92 op/s 2024-09-05T07:53:56.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:56 smithi144 ceph-mon[29535]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 292 MiB/s wr, 84 op/s 2024-09-05T07:53:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:56 smithi175 ceph-mon[34585]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 292 MiB/s wr, 84 op/s 2024-09-05T07:53:56.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:56 smithi154 ceph-mon[34710]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 292 MiB/s wr, 84 op/s 2024-09-05T07:53:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:53:58 smithi144 ceph-mon[29535]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 205 MiB/s wr, 62 op/s 2024-09-05T07:53:58.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:53:58 smithi175 ceph-mon[34585]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 205 MiB/s wr, 62 op/s 2024-09-05T07:53:58.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:53:58 smithi154 ceph-mon[34710]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 205 MiB/s wr, 62 op/s 2024-09-05T07:54:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:00 smithi144 ceph-mon[29535]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 262 MiB/s wr, 80 op/s 2024-09-05T07:54:00.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:00 smithi175 ceph-mon[34585]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 262 MiB/s wr, 80 op/s 2024-09-05T07:54:00.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:00 smithi154 ceph-mon[34710]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 262 MiB/s wr, 80 op/s 2024-09-05T07:54:02.824 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:02 smithi144 ceph-mon[29535]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 238 MiB/s wr, 72 op/s 2024-09-05T07:54:02.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:02 smithi175 ceph-mon[34585]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 238 MiB/s wr, 72 op/s 2024-09-05T07:54:02.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:02 smithi154 ceph-mon[34710]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 238 MiB/s wr, 72 op/s 2024-09-05T07:54:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 -- 172.21.15.144:0/1687967366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 msgr2=0x7f5e241031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 --2- 172.21.15.144:0/1687967366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 0x7f5e241031d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e1002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 -- 172.21.15.144:0/1687967366 shutdown_connections 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 --2- 172.21.15.144:0/1687967366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24103710 0x7f5e24109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 --2- 172.21.15.144:0/1687967366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 0x7f5e241031d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 --2- 172.21.15.144:0/1687967366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e24101b60 0x7f5e24101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.362+0000 7f5e2b000640 1 -- 172.21.15.144:0/1687967366 >> 172.21.15.144:0/1687967366 conn(0x7f5e240fd2e0 msgr2=0x7f5e240ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.363+0000 7f5e2b000640 1 -- 172.21.15.144:0/1687967366 shutdown_connections 2024-09-05T07:54:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.363+0000 7f5e2b000640 1 -- 172.21.15.144:0/1687967366 wait complete. 2024-09-05T07:54:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 Processor -- start 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 -- start start 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 0x7f5e24196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e24103710 0x7f5e2419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2410b660 con 0x7f5e24103710 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2410b4e0 con 0x7f5e24101b60 2024-09-05T07:54:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.364+0000 7f5e2b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2410b7e0 con 0x7f5e24102d50 2024-09-05T07:54:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.366+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.366+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39744/0 (socket says 172.21.15.144:39744) 2024-09-05T07:54:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.366+0000 7f5e23e00640 1 -- 172.21.15.144:0/374339927 learned_addr learned my addr 172.21.15.144:0/374339927 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.367+0000 7f5e23e00640 1 -- 172.21.15.144:0/374339927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 msgr2=0x7f5e24196130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T07:54:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.367+0000 7f5e23e00640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 0x7f5e24196130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.367+0000 7f5e23e00640 1 -- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e24103710 msgr2=0x7f5e2419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.367+0000 7f5e23e00640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e24103710 0x7f5e2419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.367+0000 7f5e23e00640 1 -- 172.21.15.144:0/374339927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2419d810 con 0x7f5e24101b60 2024-09-05T07:54:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.369+0000 7f5e23e00640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400e9c0 tx=0x7f5e1400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.369+0000 7f5e20c00640 1 -- 172.21.15.144:0/374339927 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400cd80 con 0x7f5e24101b60 2024-09-05T07:54:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.369+0000 7f5e20c00640 1 -- 172.21.15.144:0/374339927 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e140035f0 con 0x7f5e24101b60 2024-09-05T07:54:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.369+0000 7f5e20c00640 1 -- 172.21.15.144:0/374339927 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14010690 con 0x7f5e24101b60 2024-09-05T07:54:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.370+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2419db00 con 0x7f5e24101b60 2024-09-05T07:54:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.372+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2419e000 con 0x7f5e24101b60 2024-09-05T07:54:04.377 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.377+0000 7f5e2de62740 1 Processor -- start 2024-09-05T07:54:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.377+0000 7f5e2de62740 1 -- start start 2024-09-05T07:54:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.377+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45b1e0 0x556e6c45fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c462730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e2de62740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556e6c3b7100 con 0x556e6c45b1e0 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e2de62740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e6c35f1b0 con 0x556e6c460270 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e2de62740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556e6c3b30c0 con 0x556e6c45a8a0 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46290/0 (socket says 172.21.15.144:46290) 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 -- 172.21.15.144:0/799949688 learned_addr learned my addr 172.21.15.144:0/799949688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e23400640 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c462730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 -- 172.21.15.144:0/799949688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 msgr2=0x556e6c462730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c462730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 -- 172.21.15.144:0/799949688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45b1e0 msgr2=0x556e6c45fca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45b1e0 0x556e6c45fca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.378+0000 7f5e29000640 1 -- 172.21.15.144:0/799949688 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6c0ca210 con 0x556e6c45a8a0 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.379+0000 7f5e29000640 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009ea0 tx=0x7f5e1c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46770bc2c96f3c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.379+0000 7f5e19600640 1 -- 172.21.15.144:0/799949688 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c004d20 con 0x556e6c45a8a0 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.379+0000 7f5e19600640 1 -- 172.21.15.144:0/799949688 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e1c00ee60 con 0x556e6c45a8a0 2024-09-05T07:54:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.379+0000 7f5e19600640 1 -- 172.21.15.144:0/799949688 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c004d20 con 0x556e6c45a8a0 2024-09-05T07:54:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.380+0000 7f5e20c00640 1 -- 172.21.15.144:0/374339927 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5e140037a0 con 0x7f5e24101b60 2024-09-05T07:54:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.381+0000 7f5e2de62740 1 -- 172.21.15.144:0/799949688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 msgr2=0x556e6c45aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.381+0000 7f5e2de62740 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009ea0 tx=0x7f5e1c009f90 comp rx=0 tx=0).stop 2024-09-05T07:54:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.383+0000 7f5e20c00640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 0x7f5e080a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.383+0000 7f5e20c00640 1 -- 172.21.15.144:0/374339927 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f5e140cf520 con 0x7f5e24101b60 2024-09-05T07:54:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e29000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 0x7f5e080a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 -- 172.21.15.144:0/799949688 shutdown_connections 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c462730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45b1e0 0x556e6c45fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 --2- 172.21.15.144:0/799949688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45a8a0 0x556e6c45aca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 -- 172.21.15.144:0/799949688 >> 172.21.15.144:0/799949688 conn(0x556e6c44d700 msgr2=0x556e6c44db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.384+0000 7f5e2de62740 1 -- 172.21.15.144:0/799949688 shutdown_connections 2024-09-05T07:54:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.385+0000 7f5e2de62740 1 -- 172.21.15.144:0/799949688 wait complete. 2024-09-05T07:54:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.385+0000 7f5e2de62740 1 -- start start 2024-09-05T07:54:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.385+0000 7f5e2de62740 1 Processor -- start 2024-09-05T07:54:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.386+0000 7f5e29000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 0x7f5e080a5170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0049d0 tx=0x7f5e1c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.386+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.386+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c464f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.386+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c46bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e2de62740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556e6c463240 con 0x556e6c460270 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e2de62740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e6c340090 con 0x556e6c45a8a0 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e2de62740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556e6c4633c0 con 0x556e6c45b1e0 2024-09-05T07:54:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e29000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c46bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39762/0 (socket says 172.21.15.144:39762) 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.387+0000 7f5e23e00640 1 -- 172.21.15.144:0/493589804 learned_addr learned my addr 172.21.15.144:0/493589804 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e2de62740 10 client.0 _ll_register_callbacks cb 0x556e6c394f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 -- 172.21.15.144:0/493589804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 msgr2=0x556e6c464f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c464f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 -- 172.21.15.144:0/493589804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 msgr2=0x556e6c46bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c46bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 -- 172.21.15.144:0/493589804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6c196620 con 0x556e6c45a8a0 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e29000640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c46bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e1c00ee60 con 0x556e6c45a8a0 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e23e00640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e1409bd00 tx=0x7f5e1409b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225e6b65404060bf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.388+0000 7f5e0e000640 10 client.25331 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e0e000640 1 -- 172.21.15.144:0/493589804 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1409bd70 con 0x556e6c45a8a0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e0e000640 1 -- 172.21.15.144:0/493589804 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f5e140983e0 con 0x556e6c45a8a0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e0e000640 1 -- 172.21.15.144:0/493589804 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e140a0120 con 0x556e6c45a8a0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e2de62740 10 client.25331 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556e6c46ed40 con 0x556e6c45a8a0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e0e000640 1 -- 172.21.15.144:0/493589804 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e1407abe0 con 0x556e6c45a8a0 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e2de62740 10 client.25331 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.389+0000 7f5e2de62740 10 client.25331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.390+0000 7f5e2de62740 20 client.25331 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.390+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c470370 0x556e6c472780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.390+0000 7f5e2de62740 4 client.25331 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:54:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.390+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e6c3c4830 con 0x556e6c470370 2024-09-05T07:54:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.390+0000 7f5e23400640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c470370 0x556e6c472780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.391+0000 7f5e23400640 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c470370 0x556e6c472780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4257194ebf21c6d6 server_cookie=721c6ff98986c7ea in_seq=0 out_seq=0 2024-09-05T07:54:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.391+0000 7f5e0e000640 10 client.25331 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e0e000640 1 -- 172.21.15.144:0/493589804 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e6c3c4830 con 0x556e6c470370 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e0e000640 10 client.25331 handle_command_reply: tid=0 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 client.25331 shutdown 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 msgr2=0x556e6c464a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e1409bd00 tx=0x7f5e1409b970 comp rx=0 tx=0).stop 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 shutdown_connections 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c470370 0x556e6c472780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c46bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c464f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 --2- 172.21.15.144:0/493589804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c464a40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 >> 172.21.15.144:0/493589804 conn(0x556e6c44d700 msgr2=0x556e6c44ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e0e000640 0 client.25331 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.392+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 shutdown_connections 2024-09-05T07:54:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.393+0000 7f5e2de62740 1 -- 172.21.15.144:0/493589804 wait complete. 2024-09-05T07:54:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.393+0000 7f5e2de62740 20 client.25331 trim_cache size 0 max 16384 2024-09-05T07:54:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.409+0000 7f5e2de62740 1 Processor -- start 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 -- start start 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c46bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c44dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a6e00 con 0x556e6c460270 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a8940 con 0x556e6c45a8a0 2024-09-05T07:54:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e2de62740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a74d0 con 0x556e6c45b1e0 2024-09-05T07:54:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39778/0 (socket says 172.21.15.144:39778) 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e23e00640 1 -- 172.21.15.144:0/204635118 learned_addr learned my addr 172.21.15.144:0/204635118 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e23400640 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c46bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.410+0000 7f5e29000640 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c44dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 -- 172.21.15.144:0/204635118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 msgr2=0x556e6c46bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c46bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 -- 172.21.15.144:0/204635118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 msgr2=0x556e6c44dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c44dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 -- 172.21.15.144:0/204635118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6c44d520 con 0x556e6c45a8a0 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e23e00640 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005f60 tx=0x7f5e140b1000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5234252672530ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e18c00640 1 -- 172.21.15.144:0/204635118 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1409bd70 con 0x556e6c45a8a0 2024-09-05T07:54:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e18c00640 1 -- 172.21.15.144:0/204635118 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e1c00ee60 con 0x556e6c45a8a0 2024-09-05T07:54:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.411+0000 7f5e18c00640 1 -- 172.21.15.144:0/204635118 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e140cf340 con 0x556e6c45a8a0 2024-09-05T07:54:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 -- 172.21.15.144:0/204635118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 msgr2=0x556e6c45ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005f60 tx=0x7f5e140b1000 comp rx=0 tx=0).stop 2024-09-05T07:54:04.415 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 -- 172.21.15.144:0/204635118 shutdown_connections 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c460270 0x556e6c44dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c46bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 --2- 172.21.15.144:0/204635118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c45a8a0 0x556e6c45ac80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.412+0000 7f5e2de62740 1 -- 172.21.15.144:0/204635118 >> 172.21.15.144:0/204635118 conn(0x556e6c44d700 msgr2=0x556e6c464a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.413+0000 7f5e2de62740 1 -- 172.21.15.144:0/204635118 shutdown_connections 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.413+0000 7f5e2de62740 1 -- 172.21.15.144:0/204635118 wait complete. 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.413+0000 7f5e2de62740 1 -- start start 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 Processor -- start 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 0x556e6c468e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c469360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.416 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a8270 con 0x556e6c45a8a0 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a7ba0 con 0x556e6c460270 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241a4de0 con 0x556e6c45b1e0 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.414+0000 7f5e2de62740 10 client.0 _ll_register_callbacks cb 0x7f5e14003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:39782/0 (socket says 172.21.15.144:39782) 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 -- 172.21.15.144:0/1502096369 learned_addr learned my addr 172.21.15.144:0/1502096369 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e23400640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c469360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.417 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e23e00640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 0x556e6c468e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 -- 172.21.15.144:0/1502096369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 msgr2=0x556e6c469360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c469360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.415+0000 7f5e29000640 1 -- 172.21.15.144:0/1502096369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 msgr2=0x556e6c468e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.416+0000 7f5e29000640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 0x556e6c468e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.416+0000 7f5e29000640 1 -- 172.21.15.144:0/1502096369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6c4d95c0 con 0x556e6c460270 2024-09-05T07:54:04.418 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.416+0000 7f5e23e00640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 0x556e6c468e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:54:04.419 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.418+0000 7f5e29000640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009ea0 tx=0x7f5e1c009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532427d808d86851 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:04.419 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.418+0000 7f5e0e000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-05T07:54:04.419 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.418+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c035060 con 0x556e6c460270 2024-09-05T07:54:04.419 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.418+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f5e1c019710 con 0x556e6c460270 2024-09-05T07:54:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.419+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e1c00ee60 con 0x556e6c460270 2024-09-05T07:54:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.419+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e1c01d040 con 0x556e6c460270 2024-09-05T07:54:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.419+0000 7f5e2de62740 10 client.25337 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.419+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556e6c4da8d0 con 0x556e6c460270 2024-09-05T07:54:04.421 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.420+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e1c00ee60 con 0x556e6c460270 2024-09-05T07:54:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e1c010c50 con 0x556e6c460270 2024-09-05T07:54:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 10 client.25337 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 10 client.25337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 20 client.25337 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c4daf90 0x556e6c4dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 4 client.25337 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:54:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.421+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e6c448d80 con 0x556e6c4daf90 2024-09-05T07:54:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.422+0000 7f5e23e00640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c4daf90 0x556e6c4dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.423+0000 7f5e0e000640 10 client.25337 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.423+0000 7f5e23e00640 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c4daf90 0x556e6c4dd380 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dc79be8607bbcf7 server_cookie=38b54f57ac03b4e8 in_seq=0 out_seq=0 2024-09-05T07:54:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e0e000640 1 -- 172.21.15.144:0/1502096369 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e6c448d80 con 0x556e6c4daf90 2024-09-05T07:54:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e0e000640 10 client.25337 handle_command_reply: tid=0 2024-09-05T07:54:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 client.25337 shutdown 2024-09-05T07:54:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 msgr2=0x556e6c4d9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009ea0 tx=0x7f5e1c009ae0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 shutdown_connections 2024-09-05T07:54:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556e6c4daf90 0x556e6c4dd380 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e6c460270 0x556e6c4d9050 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e6c45b1e0 0x556e6c469360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 --2- 172.21.15.144:0/1502096369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556e6c45a8a0 0x556e6c468e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e0e000640 0 client.25337 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 >> 172.21.15.144:0/1502096369 conn(0x556e6c44d700 msgr2=0x556e6c44c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.433+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 shutdown_connections 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.434+0000 7f5e2de62740 1 -- 172.21.15.144:0/1502096369 wait complete. 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.434+0000 7f5e2de62740 20 client.25337 trim_cache size 0 max 16384 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:54:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 msgr2=0x7f5e080a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 0x7f5e080a5170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0049d0 tx=0x7f5e1c004a40 comp rx=0 tx=0).stop 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 msgr2=0x7f5e24195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400e9c0 tx=0x7f5e1400ee80 comp rx=0 tx=0).stop 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 shutdown_connections 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f5e080a2cb0 0x7f5e080a5170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e24103710 0x7f5e2419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e24102d50 0x7f5e24196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 --2- 172.21.15.144:0/374339927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e24101b60 0x7f5e24195bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 >> 172.21.15.144:0/374339927 conn(0x7f5e240fd2e0 msgr2=0x7f5e24106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 shutdown_connections 2024-09-05T07:54:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:04.435+0000 7f5e2b000640 1 -- 172.21.15.144:0/374339927 wait complete. 2024-09-05T07:54:04.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:04 smithi144 ceph-mon[29535]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 264 MiB/s wr, 81 op/s 2024-09-05T07:54:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:04 smithi175 ceph-mon[34585]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 264 MiB/s wr, 81 op/s 2024-09-05T07:54:04.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:04 smithi154 ceph-mon[34710]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 264 MiB/s wr, 81 op/s 2024-09-05T07:54:06.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:06 smithi144 ceph-mon[29535]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 331 MiB/s wr, 94 op/s 2024-09-05T07:54:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:06 smithi175 ceph-mon[34585]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 331 MiB/s wr, 94 op/s 2024-09-05T07:54:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:06 smithi154 ceph-mon[34710]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 331 MiB/s wr, 94 op/s 2024-09-05T07:54:08.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:08 smithi144 ceph-mon[29535]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 301 MiB/s wr, 87 op/s 2024-09-05T07:54:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:08 smithi175 ceph-mon[34585]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 301 MiB/s wr, 87 op/s 2024-09-05T07:54:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:08 smithi154 ceph-mon[34710]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 301 MiB/s wr, 87 op/s 2024-09-05T07:54:10.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:10 smithi144 ceph-mon[29535]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 397 MiB/s wr, 117 op/s 2024-09-05T07:54:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:10 smithi175 ceph-mon[34585]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 397 MiB/s wr, 117 op/s 2024-09-05T07:54:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:10 smithi154 ceph-mon[34710]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 397 MiB/s wr, 117 op/s 2024-09-05T07:54:12.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:12 smithi144 ceph-mon[29535]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 369 MiB/s wr, 106 op/s 2024-09-05T07:54:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:12 smithi175 ceph-mon[34585]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 369 MiB/s wr, 106 op/s 2024-09-05T07:54:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:12 smithi154 ceph-mon[34710]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 369 MiB/s wr, 106 op/s 2024-09-05T07:54:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:14 smithi144 ceph-mon[29535]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 364 MiB/s wr, 107 op/s 2024-09-05T07:54:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:14 smithi175 ceph-mon[34585]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 364 MiB/s wr, 107 op/s 2024-09-05T07:54:14.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:14 smithi154 ceph-mon[34710]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 364 MiB/s wr, 107 op/s 2024-09-05T07:54:16.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:16 smithi144 ceph-mon[29535]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 411 MiB/s wr, 115 op/s 2024-09-05T07:54:16.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:16 smithi175 ceph-mon[34585]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 411 MiB/s wr, 115 op/s 2024-09-05T07:54:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:16 smithi154 ceph-mon[34710]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 411 MiB/s wr, 115 op/s 2024-09-05T07:54:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.667+0000 7fb21b600640 1 -- 172.21.15.144:0/1060268358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214104f50 msgr2=0x7fb2141053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.667+0000 7fb21b600640 1 --2- 172.21.15.144:0/1060268358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214104f50 0x7fb2141053d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb200009900 tx=0x7fb20002a420 comp rx=0 tx=0).stop 2024-09-05T07:54:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.668+0000 7fb21b600640 1 -- 172.21.15.144:0/1060268358 shutdown_connections 2024-09-05T07:54:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.668+0000 7fb21b600640 1 --2- 172.21.15.144:0/1060268358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214105910 0x7fb21410c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.669+0000 7fb21b600640 1 --2- 172.21.15.144:0/1060268358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214104f50 0x7fb2141053d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.669+0000 7fb21b600640 1 --2- 172.21.15.144:0/1060268358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb214103d60 0x7fb214104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.669+0000 7fb21b600640 1 -- 172.21.15.144:0/1060268358 >> 172.21.15.144:0/1060268358 conn(0x7fb2140ff4e0 msgr2=0x7fb214101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.671+0000 7fb21b600640 1 -- 172.21.15.144:0/1060268358 shutdown_connections 2024-09-05T07:54:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.671+0000 7fb21b600640 1 -- 172.21.15.144:0/1060268358 wait complete. 2024-09-05T07:54:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.673+0000 7fb21b600640 1 Processor -- start 2024-09-05T07:54:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.673+0000 7fb21b600640 1 -- start start 2024-09-05T07:54:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb214103d60 0x7fb214071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214105910 0x7fb214073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb21406c350 con 0x7fb214104f50 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb21406c1d0 con 0x7fb214103d60 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.674+0000 7fb21b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb21406c4d0 con 0x7fb214105910 2024-09-05T07:54:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38640/0 (socket says 172.21.15.144:38640) 2024-09-05T07:54:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 -- 172.21.15.144:0/596627161 learned_addr learned my addr 172.21.15.144:0/596627161 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 -- 172.21.15.144:0/596627161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214105910 msgr2=0x7fb214073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214105910 0x7fb214073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 -- 172.21.15.144:0/596627161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb214103d60 msgr2=0x7fb214071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb214103d60 0x7fb214071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.675+0000 7fb213e00640 1 -- 172.21.15.144:0/596627161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb214073800 con 0x7fb214104f50 2024-09-05T07:54:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.676+0000 7fb213e00640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb200031610 tx=0x7fb200032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.676+0000 7fb211600640 1 -- 172.21.15.144:0/596627161 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20003f030 con 0x7fb214104f50 2024-09-05T07:54:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.676+0000 7fb211600640 1 -- 172.21.15.144:0/596627161 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb200003ad0 con 0x7fb214104f50 2024-09-05T07:54:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.676+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb214073a90 con 0x7fb214104f50 2024-09-05T07:54:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.677+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb214073f10 con 0x7fb214104f50 2024-09-05T07:54:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.678+0000 7fb211600640 1 -- 172.21.15.144:0/596627161 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200035070 con 0x7fb214104f50 2024-09-05T07:54:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 Processor -- start 2024-09-05T07:54:17.687 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 -- start start 2024-09-05T07:54:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab781eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab7821730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ab7776100 con 0x556ab781a1e0 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556ab771e1b0 con 0x556ab781f270 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.686+0000 7fb21e401740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ab77720c0 con 0x556ab78198a0 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46636/0 (socket says 172.21.15.144:46636) 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 -- 172.21.15.144:0/2952565036 learned_addr learned my addr 172.21.15.144:0/2952565036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 -- 172.21.15.144:0/2952565036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 msgr2=0x556ab7821730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab7821730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 -- 172.21.15.144:0/2952565036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 msgr2=0x556ab781eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb218c00640 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab781eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.687+0000 7fb219600640 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab781eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.688+0000 7fb219600640 1 -- 172.21.15.144:0/2952565036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab7489210 con 0x556ab78198a0 2024-09-05T07:54:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.688+0000 7fb211600640 1 -- 172.21.15.144:0/596627161 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb200042030 con 0x7fb214104f50 2024-09-05T07:54:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.688+0000 7fb218c00640 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab781eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T07:54:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.688+0000 7fb219600640 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005c40 tx=0x7fb20c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea90388f9abda5b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.690+0000 7fb205c00640 1 -- 172.21.15.144:0/2952565036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c003b70 con 0x556ab78198a0 2024-09-05T07:54:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.690+0000 7fb205c00640 1 -- 172.21.15.144:0/2952565036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c00ee60 con 0x556ab78198a0 2024-09-05T07:54:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.690+0000 7fb205c00640 1 -- 172.21.15.144:0/2952565036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c010930 con 0x556ab78198a0 2024-09-05T07:54:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb211600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 0x7fb1fc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 -- 172.21.15.144:0/2952565036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 msgr2=0x556ab7819ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005c40 tx=0x7fb20c009f90 comp rx=0 tx=0).stop 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 -- 172.21.15.144:0/2952565036 shutdown_connections 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab7821730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab781eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 --2- 172.21.15.144:0/2952565036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7819ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb21e401740 1 -- 172.21.15.144:0/2952565036 >> 172.21.15.144:0/2952565036 conn(0x556ab7814f10 msgr2=0x556ab7815310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.692+0000 7fb211600640 1 -- 172.21.15.144:0/596627161 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fb2000eef80 con 0x7fb214104f50 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.693+0000 7fb21e401740 1 -- 172.21.15.144:0/2952565036 shutdown_connections 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.693+0000 7fb21e401740 1 -- 172.21.15.144:0/2952565036 wait complete. 2024-09-05T07:54:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.693+0000 7fb218c00640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 0x7fb1fc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.693+0000 7fb21e401740 1 -- start start 2024-09-05T07:54:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 Processor -- start 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb218c00640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 0x7fb1fc0a51c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x556ab7815d90 tx=0x7fb208005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab78240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab782b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ab7822240 con 0x556ab781a1e0 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556ab76ff090 con 0x556ab781f270 2024-09-05T07:54:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ab78223c0 con 0x556ab78198a0 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.694+0000 7fb21e401740 10 client.0 _ll_register_callbacks cb 0x556ab7753f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46640/0 (socket says 172.21.15.144:46640) 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 -- 172.21.15.144:0/3902749250 learned_addr learned my addr 172.21.15.144:0/3902749250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb213e00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab78240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb219600640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab782b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 -- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 msgr2=0x556ab782b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab782b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 -- 172.21.15.144:0/3902749250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 msgr2=0x556ab78240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab78240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.695+0000 7fb218c00640 1 -- 172.21.15.144:0/3902749250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab7555620 con 0x556ab78198a0 2024-09-05T07:54:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.696+0000 7fb218c00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb208011720 tx=0x7fb208005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe5d0600a0fa1657 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.696+0000 7fb1fa000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.696+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208022020 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.696+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fb208010850 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.696+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c00ee60 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb20802d050 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 10 client.25342 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ab782deb0 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c00ee60 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb20800f040 con 0x556ab78198a0 2024-09-05T07:54:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 10 client.25342 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 10 client.25342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 20 client.25342 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab782f790 0x556ab7831c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 4 client.25342 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.697+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ab7783830 con 0x556ab782f790 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.698+0000 7fb213e00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab782f790 0x556ab7831c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.699+0000 7fb213e00640 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab782f790 0x556ab7831c30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ec4f7258f9a76f server_cookie=a67869ba3ceb75b6 in_seq=0 out_seq=0 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.699+0000 7fb1fa000640 10 client.25342 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.699+0000 7fb1fa000640 1 -- 172.21.15.144:0/3902749250 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ab7783830 con 0x556ab782f790 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.699+0000 7fb1fa000640 10 client.25342 handle_command_reply: tid=0 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 client.25342 shutdown 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 msgr2=0x556ab7823b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb208011720 tx=0x7fb208005c90 comp rx=0 tx=0).stop 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 shutdown_connections 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab782f790 0x556ab7831c30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781f270 0x556ab782b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781a1e0 0x556ab78240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 --2- 172.21.15.144:0/3902749250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab78198a0 0x556ab7823b70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 >> 172.21.15.144:0/3902749250 conn(0x556ab7814f10 msgr2=0x556ab780b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb1fa000640 0 client.25342 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 shutdown_connections 2024-09-05T07:54:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.700+0000 7fb21e401740 1 -- 172.21.15.144:0/3902749250 wait complete. 2024-09-05T07:54:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.701+0000 7fb21e401740 20 client.25342 trim_cache size 0 max 16384 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 Processor -- start 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 -- start start 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab78198a0 0x556ab780b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781a1e0 0x556ab782b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f400e580 con 0x556ab78198a0 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f40100c0 con 0x556ab781a1e0 2024-09-05T07:54:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.721+0000 7fb21e401740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f400ec50 con 0x556ab781f270 2024-09-05T07:54:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:46646/0 (socket says 172.21.15.144:46646) 2024-09-05T07:54:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 -- 172.21.15.144:0/3061045567 learned_addr learned my addr 172.21.15.144:0/3061045567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 -- 172.21.15.144:0/3061045567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781a1e0 msgr2=0x556ab782b010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T07:54:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781a1e0 0x556ab782b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 -- 172.21.15.144:0/3061045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab78198a0 msgr2=0x556ab780b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab78198a0 0x556ab780b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.722+0000 7fb219600640 1 -- 172.21.15.144:0/3061045567 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab781a6c0 con 0x556ab781f270 2024-09-05T07:54:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.723+0000 7fb219600640 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005c40 tx=0x7fb20c00efa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32312c852bffa43a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.724+0000 7fb205200640 1 -- 172.21.15.144:0/3061045567 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c026030 con 0x556ab781f270 2024-09-05T07:54:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.724+0000 7fb205200640 1 -- 172.21.15.144:0/3061045567 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c003970 con 0x556ab781f270 2024-09-05T07:54:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.724+0000 7fb205200640 1 -- 172.21.15.144:0/3061045567 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c01d040 con 0x556ab781f270 2024-09-05T07:54:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 -- 172.21.15.144:0/3061045567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 msgr2=0x556ab7823190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb20c005c40 tx=0x7fb20c00efa0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 -- 172.21.15.144:0/3061045567 shutdown_connections 2024-09-05T07:54:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab781a1e0 0x556ab782b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781f270 0x556ab7823190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 --2- 172.21.15.144:0/3061045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab78198a0 0x556ab780b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.726+0000 7fb21e401740 1 -- 172.21.15.144:0/3061045567 >> 172.21.15.144:0/3061045567 conn(0x556ab7814f10 msgr2=0x556ab780b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.727+0000 7fb21e401740 1 -- 172.21.15.144:0/3061045567 shutdown_connections 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.727+0000 7fb21e401740 1 -- 172.21.15.144:0/3061045567 wait complete. 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.727+0000 7fb21e401740 1 -- start start 2024-09-05T07:54:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 Processor -- start 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab78198a0 0x556ab7828330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781a1e0 0x556ab7828870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f400f9f0 con 0x556ab781f270 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f400f320 con 0x556ab78198a0 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f400c560 con 0x556ab781a1e0 2024-09-05T07:54:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.728+0000 7fb21e401740 10 client.0 _ll_register_callbacks cb 0x7fb2080092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38688/0 (socket says 172.21.15.144:38688) 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 -- 172.21.15.144:0/1277870083 learned_addr learned my addr 172.21.15.144:0/1277870083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb213e00640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781a1e0 0x556ab7828870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb218c00640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab78198a0 0x556ab7828330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 -- 172.21.15.144:0/1277870083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781a1e0 msgr2=0x556ab7828870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781a1e0 0x556ab7828870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 -- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab78198a0 msgr2=0x556ab7828330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab78198a0 0x556ab7828330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.729+0000 7fb219600640 1 -- 172.21.15.144:0/1277870083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab7829e90 con 0x556ab781f270 2024-09-05T07:54:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb219600640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009ea0 tx=0x7fb20c004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94765680f87b681e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb1fa000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:54:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c02e020 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fb20c018430 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c003970 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.730+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb20c018630 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 10 client.15342 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ab782b1a0 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c003970 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb20c0108b0 con 0x556ab781f270 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 10 client.15342 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 20 client.15342 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab789a8e0 0x556ab789cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 4 client.15342 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:54:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.731+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ab777db80 con 0x556ab789a8e0 2024-09-05T07:54:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.732+0000 7fb218c00640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab789a8e0 0x556ab789cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.732+0000 7fb1fa000640 10 client.15342 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.732+0000 7fb218c00640 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab789a8e0 0x556ab789cd00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bbebe7ea0a07903 server_cookie=97b87a4bc1eaa524 in_seq=0 out_seq=0 2024-09-05T07:54:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.755+0000 7fb1fa000640 1 -- 172.21.15.144:0/1277870083 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ab777db80 con 0x556ab789a8e0 2024-09-05T07:54:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.755+0000 7fb1fa000640 10 client.15342 handle_command_reply: tid=0 2024-09-05T07:54:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.756+0000 7fb21e401740 1 client.15342 shutdown 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 msgr2=0x556ab7829880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009ea0 tx=0x7fb20c004510 comp rx=0 tx=0).stop 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 shutdown_connections 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x556ab789a8e0 0x556ab789cd00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ab781f270 0x556ab7829880 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ab781a1e0 0x556ab7828870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 --2- 172.21.15.144:0/1277870083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556ab78198a0 0x556ab7828330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 >> 172.21.15.144:0/1277870083 conn(0x556ab7814f10 msgr2=0x556ab78165e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.757+0000 7fb1fa000640 0 client.15342 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.758+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 shutdown_connections 2024-09-05T07:54:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.758+0000 7fb21e401740 1 -- 172.21.15.144:0/1277870083 wait complete. 2024-09-05T07:54:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.759+0000 7fb21e401740 20 client.15342 trim_cache size 0 max 16384 2024-09-05T07:54:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:54:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:54:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:54:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:54:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.760+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 msgr2=0x7fb1fc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.760+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 0x7fb1fc0a51c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x556ab7815d90 tx=0x7fb208005e50 comp rx=0 tx=0).stop 2024-09-05T07:54:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.760+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 msgr2=0x7fb214072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.760+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb200031610 tx=0x7fb200032c80 comp rx=0 tx=0).stop 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 shutdown_connections 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb1fc0a2d00 0x7fb1fc0a51c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb214105910 0x7fb214073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb214104f50 0x7fb214072150 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 --2- 172.21.15.144:0/596627161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb214103d60 0x7fb214071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.761+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 >> 172.21.15.144:0/596627161 conn(0x7fb2140ff4e0 msgr2=0x7fb214108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.762+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 shutdown_connections 2024-09-05T07:54:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:17.763+0000 7fb21b600640 1 -- 172.21.15.144:0/596627161 wait complete. 2024-09-05T07:54:18.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:18 smithi144 ceph-mon[29535]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 340 MiB/s wr, 98 op/s 2024-09-05T07:54:18.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:18 smithi175 ceph-mon[34585]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 340 MiB/s wr, 98 op/s 2024-09-05T07:54:18.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:18 smithi154 ceph-mon[34710]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 340 MiB/s wr, 98 op/s 2024-09-05T07:54:19.197 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:19.197 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 rewriters = 363028.19 kB/sec 2024-09-05T07:54:19.197 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 rewriters = 363018.19 kB/sec 2024-09-05T07:54:19.197 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 363028.19 kB/sec 2024-09-05T07:54:19.198 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 363028.19 kB/sec 2024-09-05T07:54:19.198 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 363028.19 kB/sec 2024-09-05T07:54:19.198 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 10485760.00 kB 2024-09-05T07:54:19.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:19 smithi144 ceph-mon[29535]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 425 MiB/s wr, 121 op/s 2024-09-05T07:54:19.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:19 smithi175 ceph-mon[34585]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 425 MiB/s wr, 121 op/s 2024-09-05T07:54:19.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:19 smithi154 ceph-mon[34710]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 425 MiB/s wr, 121 op/s 2024-09-05T07:54:22.640 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:22 smithi154 ceph-mon[34710]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 361 MiB/s wr, 100 op/s 2024-09-05T07:54:22.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:22 smithi144 ceph-mon[29535]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 361 MiB/s wr, 100 op/s 2024-09-05T07:54:22.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:22 smithi175 ceph-mon[34585]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 361 MiB/s wr, 100 op/s 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 readers = 5126034.00 kB/sec 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 readers = 5124303.37 kB/sec 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 5126034.00 kB/sec 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 5126034.00 kB/sec 2024-09-05T07:54:23.966 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 5126034.00 kB/sec 2024-09-05T07:54:23.967 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 10485760.00 kB 2024-09-05T07:54:24.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:24 smithi154 ceph-mon[34710]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 339 MiB/s wr, 99 op/s 2024-09-05T07:54:24.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:24 smithi144 ceph-mon[29535]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 339 MiB/s wr, 99 op/s 2024-09-05T07:54:24.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:24 smithi175 ceph-mon[34585]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 339 MiB/s wr, 99 op/s 2024-09-05T07:54:26.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:26 smithi154 ceph-mon[34710]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 283 MiB/s wr, 82 op/s 2024-09-05T07:54:26.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:26 smithi144 ceph-mon[29535]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 283 MiB/s wr, 82 op/s 2024-09-05T07:54:26.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:26 smithi175 ceph-mon[34585]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 283 MiB/s wr, 82 op/s 2024-09-05T07:54:28.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:28 smithi154 ceph-mon[34710]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 182 MiB/s wr, 57 op/s 2024-09-05T07:54:28.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:28 smithi144 ceph-mon[29535]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 182 MiB/s wr, 57 op/s 2024-09-05T07:54:28.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:28 smithi175 ceph-mon[34585]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 182 MiB/s wr, 57 op/s 2024-09-05T07:54:29.049 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:29.049 INFO:tasks.workunit.client.0.smithi144.stdout: Children see throughput for 1 re-readers = 3559296.75 kB/sec 2024-09-05T07:54:29.049 INFO:tasks.workunit.client.0.smithi144.stdout: Parent sees throughput for 1 re-readers = 3558468.32 kB/sec 2024-09-05T07:54:29.050 INFO:tasks.workunit.client.0.smithi144.stdout: Min throughput per process = 3559296.75 kB/sec 2024-09-05T07:54:29.050 INFO:tasks.workunit.client.0.smithi144.stdout: Max throughput per process = 3559296.75 kB/sec 2024-09-05T07:54:29.050 INFO:tasks.workunit.client.0.smithi144.stdout: Avg throughput per process = 3559296.75 kB/sec 2024-09-05T07:54:29.050 INFO:tasks.workunit.client.0.smithi144.stdout: Min xfer = 10485760.00 kB 2024-09-05T07:54:30.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:30 smithi154 ceph-mon[34710]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 167 MiB/s wr, 56 op/s 2024-09-05T07:54:30.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:30 smithi144 ceph-mon[29535]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 167 MiB/s wr, 56 op/s 2024-09-05T07:54:30.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:30 smithi175 ceph-mon[34585]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 167 MiB/s wr, 56 op/s 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 -- 172.21.15.144:0/2876678477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730105910 msgr2=0x7fa73010c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 --2- 172.21.15.144:0/2876678477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730105910 0x7fa73010c1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009ca0 tx=0x7fa72c02a8c0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 -- 172.21.15.144:0/2876678477 shutdown_connections 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 --2- 172.21.15.144:0/2876678477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730105910 0x7fa73010c1a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 --2- 172.21.15.144:0/2876678477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730104f50 0x7fa7301053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 --2- 172.21.15.144:0/2876678477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 -- 172.21.15.144:0/2876678477 >> 172.21.15.144:0/2876678477 conn(0x7fa7300ff4e0 msgr2=0x7fa730101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 -- 172.21.15.144:0/2876678477 shutdown_connections 2024-09-05T07:54:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.895+0000 7fa738800640 1 -- 172.21.15.144:0/2876678477 wait complete. 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.896+0000 7fa738800640 1 Processor -- start 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.896+0000 7fa738800640 1 -- start start 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730105910 0x7fa7301a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa73010fa30 con 0x7fa730104f50 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73010f8b0 con 0x7fa730103d60 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa738800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa73010fbb0 con 0x7fa730105910 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56888/0 (socket says 172.21.15.144:56888) 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa735400640 1 -- 172.21.15.144:0/826707576 learned_addr learned my addr 172.21.15.144:0/826707576 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa735e00640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa736800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730105910 0x7fa7301a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.897+0000 7fa735400640 1 -- 172.21.15.144:0/826707576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730105910 msgr2=0x7fa7301a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735400640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730105910 0x7fa7301a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735400640 1 -- 172.21.15.144:0/826707576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 msgr2=0x7fa730199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735400640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735400640 1 -- 172.21.15.144:0/826707576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7301a1b70 con 0x7fa730104f50 2024-09-05T07:54:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735e00640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa735400640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa72000e9f0 tx=0x7fa72000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa72aa00640 1 -- 172.21.15.144:0/826707576 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72000cd80 con 0x7fa730104f50 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa72aa00640 1 -- 172.21.15.144:0/826707576 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa720005500 con 0x7fa730104f50 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7301a1e60 con 0x7fa730104f50 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa72aa00640 1 -- 172.21.15.144:0/826707576 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720010690 con 0x7fa730104f50 2024-09-05T07:54:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.898+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7301a2320 con 0x7fa730104f50 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.901+0000 7fa73b6b0740 1 Processor -- start 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.901+0000 7fa72aa00640 1 -- 172.21.15.144:0/826707576 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fa7200046c0 con 0x7fa730104f50 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.901+0000 7fa73b6b0740 1 -- start start 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c159437490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c15943ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c15939c100 con 0x55c1594379d0 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c1593441b0 con 0x55c15943ca60 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c1593980c0 con 0x55c159437090 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56898/0 (socket says 172.21.15.144:56898) 2024-09-05T07:54:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 -- 172.21.15.144:0/3582705028 learned_addr learned my addr 172.21.15.144:0/3582705028 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735400640 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c15943ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa736800640 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c159437490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 -- 172.21.15.144:0/3582705028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 msgr2=0x55c159437490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c159437490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 -- 172.21.15.144:0/3582705028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 msgr2=0x55c15943ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.902+0000 7fa735e00640 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c15943ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa735e00640 1 -- 172.21.15.144:0/3582705028 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1590af210 con 0x55c1594379d0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa735e00640 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa7240114c0 tx=0x7fa724011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2d97108d95e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa72aa00640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 0x7fa7180a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa71f000640 1 -- 172.21.15.144:0/3582705028 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724004020 con 0x55c1594379d0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa71f000640 1 -- 172.21.15.144:0/3582705028 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa724005500 con 0x55c1594379d0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa72aa00640 1 -- 172.21.15.144:0/826707576 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa7200cf400 con 0x7fa730104f50 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa71f000640 1 -- 172.21.15.144:0/3582705028 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724004e10 con 0x55c1594379d0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.903+0000 7fa736800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 0x7fa7180a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 -- 172.21.15.144:0/3582705028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 msgr2=0x55c15943c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa7240114c0 tx=0x7fa724011980 comp rx=0 tx=0).stop 2024-09-05T07:54:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa736800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 0x7fa7180a5170 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005e30 tx=0x7fa72c031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 -- 172.21.15.144:0/3582705028 shutdown_connections 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c15943ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c15943c490 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/3582705028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c159437490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 -- 172.21.15.144:0/3582705028 >> 172.21.15.144:0/3582705028 conn(0x55c159432700 msgr2=0x55c159432b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 -- 172.21.15.144:0/3582705028 shutdown_connections 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.904+0000 7fa73b6b0740 1 -- 172.21.15.144:0/3582705028 wait complete. 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 -- start start 2024-09-05T07:54:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 Processor -- start 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159448770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c15943fa30 con 0x55c1594379d0 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c159325090 con 0x55c15943ca60 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c15943fbb0 con 0x55c159437090 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa73b6b0740 10 client.0 _ll_register_callbacks cb 0x55c159379f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.905+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56908/0 (socket says 172.21.15.144:56908) 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 -- 172.21.15.144:0/4271955402 learned_addr learned my addr 172.21.15.144:0/4271955402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa736800640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159448770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735e00640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 -- 172.21.15.144:0/4271955402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 msgr2=0x55c1594411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 -- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 msgr2=0x55c159448770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159448770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 -- 172.21.15.144:0/4271955402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c15917b620 con 0x55c1594379d0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa735400640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa72009bb80 tx=0x7fa720004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30f7a6e0e22623f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa713400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72009b550 con 0x55c1594379d0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa7200a45d0 con 0x55c1594379d0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.906+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa724005500 con 0x55c1594379d0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa72009c2f0 con 0x55c1594379d0 2024-09-05T07:54:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 10 client.15354 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c15944b5d0 con 0x55c1594379d0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa724005500 con 0x55c1594379d0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa72009aab0 con 0x55c1594379d0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 10 client.15354 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 20 client.15354 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c15944cca0 0x55c15944f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 4 client.15354 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.907+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1593a9830 con 0x55c15944cca0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.908+0000 7fa735e00640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c15944cca0 0x55c15944f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.908+0000 7fa735e00640 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c15944cca0 0x55c15944f0d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76a518e2c7aec25 server_cookie=ff05a9b81d80508f in_seq=0 out_seq=0 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.908+0000 7fa713400640 10 client.15354 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa713400640 1 -- 172.21.15.144:0/4271955402 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1593a9830 con 0x55c15944cca0 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa713400640 10 client.15354 handle_command_reply: tid=0 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 client.15354 shutdown 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 msgr2=0x55c159441730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa72009bb80 tx=0x7fa720004ba0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 shutdown_connections 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c15944cca0 0x55c15944f0d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159448770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159441730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa713400640 0 client.15354 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4271955402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 >> 172.21.15.144:0/4271955402 conn(0x55c159432700 msgr2=0x55c159433f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 shutdown_connections 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4271955402 wait complete. 2024-09-05T07:54:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.909+0000 7fa73b6b0740 20 client.15354 trim_cache size 0 max 16384 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.924+0000 7fa73b6b0740 1 Processor -- start 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 -- start start 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159433af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301ab130 con 0x55c1594379d0 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301acc70 con 0x55c15943ca60 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301ab800 con 0x55c159437090 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56920/0 (socket says 172.21.15.144:56920) 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 -- 172.21.15.144:0/1951206658 learned_addr learned my addr 172.21.15.144:0/1951206658 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735e00640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa736800640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159433af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 -- 172.21.15.144:0/1951206658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 msgr2=0x55c1594335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594335b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 -- 172.21.15.144:0/1951206658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 msgr2=0x55c159433af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159433af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735400640 1 -- 172.21.15.144:0/1951206658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15942dd60 con 0x55c1594379d0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.925+0000 7fa735e00640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa735400640 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c6a0 tx=0x7fa72000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbcdb4152cd47ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa71e600640 1 -- 172.21.15.144:0/1951206658 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72009b550 con 0x55c1594379d0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa71e600640 1 -- 172.21.15.144:0/1951206658 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa720086040 con 0x55c1594379d0 2024-09-05T07:54:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa71e600640 1 -- 172.21.15.144:0/1951206658 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72009b9c0 con 0x55c1594379d0 2024-09-05T07:54:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa73b6b0740 1 -- 172.21.15.144:0/1951206658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 msgr2=0x55c159448730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.926+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c6a0 tx=0x7fa72000cf20 comp rx=0 tx=0).stop 2024-09-05T07:54:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 -- 172.21.15.144:0/1951206658 shutdown_connections 2024-09-05T07:54:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c15943ca60 0x55c159433af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1594379d0 0x55c159448730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/1951206658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c159437090 0x55c1594335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 -- 172.21.15.144:0/1951206658 >> 172.21.15.144:0/1951206658 conn(0x55c159432700 msgr2=0x55c1594411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 -- 172.21.15.144:0/1951206658 shutdown_connections 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 -- 172.21.15.144:0/1951206658 wait complete. 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 -- start start 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.927+0000 7fa73b6b0740 1 Processor -- start 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1594379d0 0x55c159446190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c15943ca60 0x55c1594471a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301ac5a0 con 0x55c159437090 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301abed0 con 0x55c1594379d0 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7301a9110 con 0x55c15943ca60 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa73b6b0740 10 client.0 _ll_register_callbacks cb 0x7fa7200d2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:54:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56926/0 (socket says 172.21.15.144:56926) 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 -- 172.21.15.144:0/4243370499 learned_addr learned my addr 172.21.15.144:0/4243370499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735400640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1594379d0 0x55c159446190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa736800640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c15943ca60 0x55c1594471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 -- 172.21.15.144:0/4243370499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c15943ca60 msgr2=0x55c1594471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c15943ca60 0x55c1594471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 -- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1594379d0 msgr2=0x55c159446190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1594379d0 0x55c159446190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 -- 172.21.15.144:0/4243370499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1594477b0 con 0x55c159437090 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa735e00640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55c159438400 tx=0x7fa724005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7424a047d09cec31 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.928+0000 7fa713400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724033060 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa720086040 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa724011030 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa72401d040 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 10 client.15360 fetch_fsmap learned FSMap version 29 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c1594c0190 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa720086040 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa72402e480 con 0x55c159437090 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 10 client.15360 fetch_fsmap finished waiting for FSMap version 29 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 20 client.15360 populate_metadata read hostname 'smithi144' 2024-09-05T07:54:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.929+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c1594c07e0 0x55c1594c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.930+0000 7fa73b6b0740 4 client.15360 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-05T07:54:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.930+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 --> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1593a3b80 con 0x55c1594c07e0 2024-09-05T07:54:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.930+0000 7fa735400640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c1594c07e0 0x55c1594c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.930+0000 7fa713400640 10 client.15360 ms_handle_connect on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.930+0000 7fa735400640 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c1594c07e0 0x55c1594c2bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc09ed540f63de5 server_cookie=115cbbd5f8ed2152 in_seq=0 out_seq=0 2024-09-05T07:54:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.939+0000 7fa713400640 1 -- 172.21.15.144:0/4243370499 <== mds.0 v2:172.21.15.154:6838/3557171279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1593a3b80 con 0x55c1594c07e0 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.939+0000 7fa713400640 10 client.15360 handle_command_reply: tid=0 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.939+0000 7fa73b6b0740 1 client.15360 shutdown 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.939+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 msgr2=0x55c159445c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.939+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55c159438400 tx=0x7fa724005d30 comp rx=0 tx=0).stop 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 shutdown_connections 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:6838/3557171279,v1:172.21.15.154:6839/3557171279] conn(0x55c1594c07e0 0x55c1594c2bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1594379d0 0x55c159446190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c15943ca60 0x55c1594471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa713400640 0 client.15360 ms_handle_reset on v2:172.21.15.154:6838/3557171279 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 --2- 172.21.15.144:0/4243370499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c159437090 0x55c159445c50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 >> 172.21.15.144:0/4243370499 conn(0x55c159432700 msgr2=0x55c159431060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 shutdown_connections 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 1 -- 172.21.15.144:0/4243370499 wait complete. 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.940+0000 7fa73b6b0740 20 client.15360 trim_cache size 0 max 16384 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:{ 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "message": "", 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout: "return_code": 0 2024-09-05T07:54:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stdout:} 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 msgr2=0x7fa7180a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 0x7fa7180a5170 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005e30 tx=0x7fa72c031bb0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 msgr2=0x7fa73019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa72000e9f0 tx=0x7fa72000edf0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 shutdown_connections 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa7180a2cb0 0x7fa7180a5170 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa730105910 0x7fa7301a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa730104f50 0x7fa73019a490 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 --2- 172.21.15.144:0/826707576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa730103d60 0x7fa730199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 >> 172.21.15.144:0/826707576 conn(0x7fa7300ff4e0 msgr2=0x7fa7301081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 shutdown_connections 2024-09-05T07:54:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi144.front.sepia.ceph.com.smithi144.stderr:2024-09-05T07:54:30.941+0000 7fa738800640 1 -- 172.21.15.144:0/826707576 wait complete. 2024-09-05T07:54:32.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:32 smithi154 ceph-mon[34710]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 69 MiB/s wr, 29 op/s 2024-09-05T07:54:32.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:32 smithi144 ceph-mon[29535]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 69 MiB/s wr, 29 op/s 2024-09-05T07:54:32.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:32 smithi175 ceph-mon[34585]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 69 MiB/s wr, 29 op/s 2024-09-05T07:54:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:34 smithi154 ceph-mon[34710]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-05T07:54:34.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:34 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:54:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:34 smithi144 ceph-mon[29535]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-05T07:54:34.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:34 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:54:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:34 smithi175 ceph-mon[34585]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-09-05T07:54:34.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:34 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T07:54:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:54:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:54:35.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:35 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:54:35.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:54:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:54:35.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:35 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:54:35.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T07:54:35.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T07:54:35.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:35 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' 2024-09-05T07:54:36.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:36 smithi154 ceph-mon[34710]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-09-05T07:54:36.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:36 smithi144 ceph-mon[29535]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-09-05T07:54:36.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:36 smithi175 ceph-mon[34585]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-09-05T07:54:37.460 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:37.460 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:37.460 INFO:tasks.workunit.client.0.smithi144.stdout: 2024-09-05T07:54:37.461 INFO:tasks.workunit.client.0.smithi144.stdout:iozone test complete. 2024-09-05T07:54:37.464 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T07:54:37.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T07:54:37.575 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-05T07:54:37.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T07:54:38.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:38 smithi154 ceph-mon[34710]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T07:54:38.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:38 smithi144 ceph-mon[29535]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T07:54:38.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:38 smithi175 ceph-mon[34585]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T07:54:39.050 DEBUG:teuthology.parallel:result is None 2024-09-05T07:54:39.050 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T07:54:39.159 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T07:54:39.159 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-05T07:54:39.169 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:54:39.190 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-05T07:54:39.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 -- 172.21.15.144:0/639219934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac4074bd0 msgr2=0x7f4ac4075030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 --2- 172.21.15.144:0/639219934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac4074bd0 0x7f4ac4075030 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009860 tx=0x7f4ab002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 -- 172.21.15.144:0/639219934 shutdown_connections 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 --2- 172.21.15.144:0/639219934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac4074bd0 0x7f4ac4075030 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 --2- 172.21.15.144:0/639219934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41099e0 0x7f4ac410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 --2- 172.21.15.144:0/639219934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac40761b0 0x7f4ac4074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 -- 172.21.15.144:0/639219934 >> 172.21.15.144:0/639219934 conn(0x7f4ac40fd2b0 msgr2=0x7f4ac40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 -- 172.21.15.144:0/639219934 shutdown_connections 2024-09-05T07:54:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.475+0000 7f4acc400640 1 -- 172.21.15.144:0/639219934 wait complete. 2024-09-05T07:54:39.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.477+0000 7f4acc400640 1 Processor -- start 2024-09-05T07:54:39.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.477+0000 7f4acc400640 1 -- start start 2024-09-05T07:54:39.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 0x7f4ac419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 0x7f4ac419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac41099e0 0x7f4ac41a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac410fa00 con 0x7f4ac4074bd0 2024-09-05T07:54:39.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac410f880 con 0x7f4ac41099e0 2024-09-05T07:54:39.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4acc400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac410fb80 con 0x7f4ac40761b0 2024-09-05T07:54:39.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4ac9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 0x7f4ac419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4ac9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 0x7f4ac419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42420/0 (socket says 172.21.15.144:42420) 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4ac9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 0x7f4ac419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4ac9a00640 1 -- 172.21.15.144:0/1644993765 learned_addr learned my addr 172.21.15.144:0/1644993765 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.478+0000 7f4aca400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac41099e0 0x7f4ac41a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 -- 172.21.15.144:0/1644993765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac41099e0 msgr2=0x7f4ac41a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac41099e0 0x7f4ac41a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 -- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 msgr2=0x7f4ac419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 0x7f4ac419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 -- 172.21.15.144:0/1644993765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac41a1ca0 con 0x7f4ac40761b0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.479+0000 7f4ac9000640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 0x7f4ac419a5c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002a910 tx=0x7f4ab0032f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.480+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0005140 con 0x7f4ac40761b0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.480+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ab0031400 con 0x7f4ac40761b0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.480+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac41a1f30 con 0x7f4ac40761b0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.480+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00049b0 con 0x7f4ac40761b0 2024-09-05T07:54:39.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.480+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac41a23a0 con 0x7f4ac40761b0 2024-09-05T07:54:39.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.482+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac41087a0 con 0x7f4ac40761b0 2024-09-05T07:54:39.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.483+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4ab0039040 con 0x7f4ac40761b0 2024-09-05T07:54:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.485+0000 7f4ac2000640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 0x7f4aac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.485+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f4ab00f0780 con 0x7f4ac40761b0 2024-09-05T07:54:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.486+0000 7f4ac9a00640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 0x7f4aac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.487+0000 7f4ac9a00640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 0x7f4aac0a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009c90 tx=0x7f4ab8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.490+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ab0049060 con 0x7f4ac40761b0 2024-09-05T07:54:39.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.696+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ac402d990 con 0x7f4ac40761b0 2024-09-05T07:54:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.697+0000 7f4ac2000640 1 -- 172.21.15.144:0/1644993765 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22868 (secure 0 0 0) 0x7f4ab0040030 con 0x7f4ac40761b0 2024-09-05T07:54:39.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:54:39.699 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":85,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:50:06.457858+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.699+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 msgr2=0x7f4aac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.699+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 0x7f4aac0a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009c90 tx=0x7f4ab8005f90 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.699+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 msgr2=0x7f4ac419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.699+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 0x7f4ac419a5c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002a910 tx=0x7f4ab0032f30 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 shutdown_connections 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f4aac0a2c10 0x7f4aac0a50d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac41099e0 0x7f4ac41a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40761b0 0x7f4ac419a5c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 --2- 172.21.15.144:0/1644993765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac4074bd0 0x7f4ac419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 >> 172.21.15.144:0/1644993765 conn(0x7f4ac40fd2b0 msgr2=0x7f4ac4105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 shutdown_connections 2024-09-05T07:54:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.700+0000 7f4acc400640 1 -- 172.21.15.144:0/1644993765 wait complete. 2024-09-05T07:54:39.716 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T07:44:23.743416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-05T07:49:11.242427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-05T07:49:13.920843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T07:54:39.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-05T07:54:39.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.874+0000 7f79eb400640 1 -- 172.21.15.144:0/778160027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e4103d20 msgr2=0x7f79e4104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.874+0000 7f79eb400640 1 --2- 172.21.15.144:0/778160027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e4103d20 0x7f79e4104120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009900 tx=0x7f79d402a410 comp rx=0 tx=0).stop 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 -- 172.21.15.144:0/778160027 shutdown_connections 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 --2- 172.21.15.144:0/778160027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e41058d0 0x7f79e410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 --2- 172.21.15.144:0/778160027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 --2- 172.21.15.144:0/778160027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e4103d20 0x7f79e4104120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 -- 172.21.15.144:0/778160027 >> 172.21.15.144:0/778160027 conn(0x7f79e40ff4a0 msgr2=0x7f79e41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 -- 172.21.15.144:0/778160027 shutdown_connections 2024-09-05T07:54:39.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.875+0000 7f79eb400640 1 -- 172.21.15.144:0/778160027 wait complete. 2024-09-05T07:54:39.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 Processor -- start 2024-09-05T07:54:39.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 -- start start 2024-09-05T07:54:39.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e4103d20 0x7f79e419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e41058d0 0x7f79e41a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410f9f0 con 0x7f79e41058d0 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410f870 con 0x7f79e4103d20 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79eb400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410fb70 con 0x7f79e4104f10 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79dbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79e9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e41058d0 0x7f79e41a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79dbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36956/0 (socket says 172.21.15.144:36956) 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79dbe00640 1 -- 172.21.15.144:0/2357425023 learned_addr learned my addr 172.21.15.144:0/2357425023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:39.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.876+0000 7f79e8a00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e4103d20 0x7f79e419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 -- 172.21.15.144:0/2357425023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e4103d20 msgr2=0x7f79e419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e4103d20 0x7f79e419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 -- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e41058d0 msgr2=0x7f79e41a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e41058d0 0x7f79e41a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 -- 172.21.15.144:0/2357425023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e41a1d00 con 0x7f79e4104f10 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79dbe00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9f0 tx=0x7f79cc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ccc0 con 0x7f79e4104f10 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79cc00ce60 con 0x7f79e4104f10 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e41a1ff0 con 0x7f79e4104f10 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc010690 con 0x7f79e4104f10 2024-09-05T07:54:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.877+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e41a2460 con 0x7f79e4104f10 2024-09-05T07:54:39.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.878+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e410b180 con 0x7f79e4104f10 2024-09-05T07:54:39.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.880+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f79cc0046c0 con 0x7f79e4104f10 2024-09-05T07:54:39.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.881+0000 7f79e2000640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 0x7f79c80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:39.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.881+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f79cc0cf480 con 0x7f79e4104f10 2024-09-05T07:54:39.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.882+0000 7f79e8a00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 0x7f79c80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:39.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.882+0000 7f79e8a00640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 0x7f79c80a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79d402aa00 tx=0x7f79d40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:39.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:39.885+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79cc09c370 con 0x7f79e4104f10 2024-09-05T07:54:40.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.057+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f79e4062e90 con 0x7f79e4104f10 2024-09-05T07:54:40.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.058+0000 7f79e2000640 1 -- 172.21.15.144:0/2357425023 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f79cc09bc70 con 0x7f79e4104f10 2024-09-05T07:54:40.058 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 msgr2=0x7f79c80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 0x7f79c80a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79d402aa00 tx=0x7f79d40315b0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 msgr2=0x7f79e419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9f0 tx=0x7f79cc00edf0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 shutdown_connections 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f79c80a2b90 0x7f79c80a5050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79e41058d0 0x7f79e41a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e4104f10 0x7f79e419a620 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 --2- 172.21.15.144:0/2357425023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e4103d20 0x7f79e419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 >> 172.21.15.144:0/2357425023 conn(0x7f79e40ff4a0 msgr2=0x7f79e4108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 shutdown_connections 2024-09-05T07:54:40.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.060+0000 7f79eb400640 1 -- 172.21.15.144:0/2357425023 wait complete. 2024-09-05T07:54:40.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-05T07:54:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 -- 172.21.15.144:0/2167322424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8424103d30 msgr2=0x7f8424104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 --2- 172.21.15.144:0/2167322424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8424103d30 0x7f8424104130 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f841402a3f0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 -- 172.21.15.144:0/2167322424 shutdown_connections 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 --2- 172.21.15.144:0/2167322424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 0x7f84241053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 --2- 172.21.15.144:0/2167322424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84241058e0 0x7f842410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 --2- 172.21.15.144:0/2167322424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8424103d30 0x7f8424104130 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 -- 172.21.15.144:0/2167322424 >> 172.21.15.144:0/2167322424 conn(0x7f84240ff470 msgr2=0x7f84241018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 -- 172.21.15.144:0/2167322424 shutdown_connections 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.234+0000 7f842b200640 1 -- 172.21.15.144:0/2167322424 wait complete. 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 Processor -- start 2024-09-05T07:54:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 -- start start 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 0x7f842419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f842410fa00 con 0x7f84241058e0 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f842410f880 con 0x7f8424104f20 2024-09-05T07:54:40.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f842b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f842410fb80 con 0x7f8424103d30 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f8429200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f8423e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f8423e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36962/0 (socket says 172.21.15.144:36962) 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f8423e00640 1 -- 172.21.15.144:0/424779056 learned_addr learned my addr 172.21.15.144:0/424779056 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f8429200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42446/0 (socket says 172.21.15.144:42446) 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.235+0000 7f841be00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 0x7f842419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 -- 172.21.15.144:0/424779056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 msgr2=0x7f842419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 0x7f842419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 -- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 msgr2=0x7f84241a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 -- 172.21.15.144:0/424779056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84241a1ca0 con 0x7f8424103d30 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8429200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:54:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8423e00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8414031440 tx=0x7f8414032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403f030 con 0x7f8424103d30 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84241a1f30 con 0x7f8424103d30 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414003ce0 con 0x7f8424103d30 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.236+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035070 con 0x7f8424103d30 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.237+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84241a2390 con 0x7f8424103d30 2024-09-05T07:54:40.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.237+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842410b1c0 con 0x7f8424103d30 2024-09-05T07:54:40.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.239+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8414042030 con 0x7f8424103d30 2024-09-05T07:54:40.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.241+0000 7f8421600640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 0x7f84080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.241+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f84140ef870 con 0x7f8424103d30 2024-09-05T07:54:40.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.241+0000 7f841be00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 0x7f84080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.242+0000 7f841be00640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 0x7f84080a50d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f840c0095f0 tx=0x7f840c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.243+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84140bc110 con 0x7f8424103d30 2024-09-05T07:54:40.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.417+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f842402da10 con 0x7f8424103d30 2024-09-05T07:54:40.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.418+0000 7f8421600640 1 -- 172.21.15.144:0/424779056 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f84140c0410 con 0x7f8424103d30 2024-09-05T07:54:40.419 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2024-09-05T07:54:40.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 msgr2=0x7f84080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 0x7f84080a50d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f840c0095f0 tx=0x7f840c005f90 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 msgr2=0x7f842419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8414031440 tx=0x7f8414032ce0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 shutdown_connections 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f84080a2c10 0x7f84080a50d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8424104f20 0x7f842419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84241058e0 0x7f84241a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 --2- 172.21.15.144:0/424779056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8424103d30 0x7f842419a080 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 >> 172.21.15.144:0/424779056 conn(0x7f84240ff470 msgr2=0x7f8424108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 shutdown_connections 2024-09-05T07:54:40.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.421+0000 7f842b200640 1 -- 172.21.15.144:0/424779056 wait complete. 2024-09-05T07:54:40.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 -- 172.21.15.144:0/3416985677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa858104f20 msgr2=0x7fa8581053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 --2- 172.21.15.144:0/3416985677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa858104f20 0x7fa8581053a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa840009900 tx=0x7fa84002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 -- 172.21.15.144:0/3416985677 shutdown_connections 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 --2- 172.21.15.144:0/3416985677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8581058e0 0x7fa85810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 --2- 172.21.15.144:0/3416985677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa858104f20 0x7fa8581053a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 --2- 172.21.15.144:0/3416985677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 0x7fa858104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 -- 172.21.15.144:0/3416985677 >> 172.21.15.144:0/3416985677 conn(0x7fa8580ff470 msgr2=0x7fa8581018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 -- 172.21.15.144:0/3416985677 shutdown_connections 2024-09-05T07:54:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.596+0000 7fa85d600640 1 -- 172.21.15.144:0/3416985677 wait complete. 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 Processor -- start 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 -- start start 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 0x7fa85819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa858104f20 0x7fa85819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810f9b0 con 0x7fa8581058e0 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810f830 con 0x7fa858104f20 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa85d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa85810fb30 con 0x7fa858103d30 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa857400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa84fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa858104f20 0x7fa85819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa856a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 0x7fa85819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa857400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42468/0 (socket says 172.21.15.144:42468) 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.597+0000 7fa857400640 1 -- 172.21.15.144:0/4067737962 learned_addr learned my addr 172.21.15.144:0/4067737962 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 -- 172.21.15.144:0/4067737962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 msgr2=0x7fa85819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 0x7fa85819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 -- 172.21.15.144:0/4067737962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa858104f20 msgr2=0x7fa85819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa858104f20 0x7fa85819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 -- 172.21.15.144:0/4067737962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8581a1cc0 con 0x7fa8581058e0 2024-09-05T07:54:40.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa857400640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa85000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850017070 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa850003e50 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500106c0 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8581a1fb0 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.598+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8581a2470 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.599+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85810b190 con 0x7fa8581058e0 2024-09-05T07:54:40.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.601+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fa850003970 con 0x7fa8581058e0 2024-09-05T07:54:40.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.602+0000 7fa84f400640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 0x7fa83c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.603+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fa8500ced10 con 0x7fa8581058e0 2024-09-05T07:54:40.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.603+0000 7fa856a00640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 0x7fa83c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.603+0000 7fa856a00640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 0x7fa83c0a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa858104d80 tx=0x7fa848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.607+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8500d4020 con 0x7fa8581058e0 2024-09-05T07:54:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:40 smithi154 ceph-mon[34710]: pgmap v452: 97 pgs: 97 active+clean; 8.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 50 op/s 2024-09-05T07:54:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:40 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1644993765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:54:40.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:40 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2357425023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:54:40.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.783+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa858062e20 con 0x7fa8581058e0 2024-09-05T07:54:40.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.783+0000 7fa84f400640 1 -- 172.21.15.144:0/4067737962 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7fa85009b5b0 con 0x7fa8581058e0 2024-09-05T07:54:40.784 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 msgr2=0x7fa83c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 0x7fa83c0a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa858104d80 tx=0x7fa848005f90 comp rx=0 tx=0).stop 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 msgr2=0x7fa8581a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa85000b260 comp rx=0 tx=0).stop 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 shutdown_connections 2024-09-05T07:54:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fa83c0a2c10 0x7fa83c0a50d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa858104f20 0x7fa85819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8581058e0 0x7fa8581a1650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 --2- 172.21.15.144:0/4067737962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa858103d30 0x7fa85819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 >> 172.21.15.144:0/4067737962 conn(0x7fa8580ff470 msgr2=0x7fa858108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 shutdown_connections 2024-09-05T07:54:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.786+0000 7fa85d600640 1 -- 172.21.15.144:0/4067737962 wait complete. 2024-09-05T07:54:40.801 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:40 smithi144 ceph-mon[29535]: pgmap v452: 97 pgs: 97 active+clean; 8.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 50 op/s 2024-09-05T07:54:40.801 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:40 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1644993765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:54:40.801 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:40 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2357425023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:54:40.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-05T07:54:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:40 smithi175 ceph-mon[34585]: pgmap v452: 97 pgs: 97 active+clean; 8.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 50 op/s 2024-09-05T07:54:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:40 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1644993765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:54:40.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:40 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2357425023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T07:54:40.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 -- 172.21.15.144:0/2326836329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4104d60 msgr2=0x7f33f41051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 --2- 172.21.15.144:0/2326836329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4104d60 0x7f33f41051e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009900 tx=0x7f33e002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 -- 172.21.15.144:0/2326836329 shutdown_connections 2024-09-05T07:54:40.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 --2- 172.21.15.144:0/2326836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4105720 0x7f33f410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 --2- 172.21.15.144:0/2326836329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4104d60 0x7f33f41051e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 --2- 172.21.15.144:0/2326836329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4103b70 0x7f33f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 -- 172.21.15.144:0/2326836329 >> 172.21.15.144:0/2326836329 conn(0x7f33f40ff2f0 msgr2=0x7f33f4101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:40.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 -- 172.21.15.144:0/2326836329 shutdown_connections 2024-09-05T07:54:40.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.958+0000 7f33f9200640 1 -- 172.21.15.144:0/2326836329 wait complete. 2024-09-05T07:54:40.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 Processor -- start 2024-09-05T07:54:40.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 -- start start 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4104d60 0x7f33f419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 0x7f33f41a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410f7d0 con 0x7f33f4103b70 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410f650 con 0x7f33f4105720 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f9200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410f950 con 0x7f33f4104d60 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42490/0 (socket says 172.21.15.144:42490) 2024-09-05T07:54:40.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f3400640 1 -- 172.21.15.144:0/2257356823 learned_addr learned my addr 172.21.15.144:0/2257356823 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.959+0000 7f33f2a00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4104d60 0x7f33f419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3e00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 0x7f33f41a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 -- 172.21.15.144:0/2257356823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4104d60 msgr2=0x7f33f419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4104d60 0x7f33f419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 -- 172.21.15.144:0/2257356823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 msgr2=0x7f33f41a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 0x7f33f41a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 -- 172.21.15.144:0/2257356823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41a1b00 con 0x7f33f4103b70 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3e00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 0x7f33f41a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f3400640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33e400e9c0 tx=0x7f33e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e400cd80 con 0x7f33f4103b70 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33e40035f0 con 0x7f33f4103b70 2024-09-05T07:54:40.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a1df0 con 0x7f33f4103b70 2024-09-05T07:54:40.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4010690 con 0x7f33f4103b70 2024-09-05T07:54:40.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.960+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a2250 con 0x7f33f4103b70 2024-09-05T07:54:40.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.961+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f410afb0 con 0x7f33f4103b70 2024-09-05T07:54:40.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.963+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f33e40037a0 con 0x7f33f4103b70 2024-09-05T07:54:40.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.964+0000 7f33ebe00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 0x7f33d80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:54:40.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.965+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f33e40cf520 con 0x7f33f4103b70 2024-09-05T07:54:40.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.965+0000 7f33f2a00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 0x7f33d80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:54:40.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.965+0000 7f33f2a00640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 0x7f33d80a5050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f33e00314e0 tx=0x7f33e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:54:40.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:40.968+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33e409c410 con 0x7f33f4103b70 2024-09-05T07:54:41.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.188+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f33f4062ec0 con 0x7f33f4103b70 2024-09-05T07:54:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.198+0000 7f33ebe00640 1 -- 172.21.15.144:0/2257356823 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+740379 (secure 0 0 0) 0x7f33e409bd10 con 0x7f33f4103b70 2024-09-05T07:54:41.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:54:41.209 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:54:41.209 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 20, 2024-09-05T07:54:41.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "active_gid": 14150, 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "active_name": "x", 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "active_addrs": { 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:6800", 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2361768482 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:6801", 2024-09-05T07:54:41.210 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2361768482 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "active_addr": "172.21.15.144:6801/2361768482", 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "active_change": "2024-09-05T07:42:05.153902+0000", 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "active_mgr_features": 4540701547738038271, 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "standbys": [ 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 24109, 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "z", 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr_features": 4540701547738038271, 2024-09-05T07:54:41.211 INFO:teuthology.orchestra.run.smithi144.stdout: "available_modules": [ 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "alerts", 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.214 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.215 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.216 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.217 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.218 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_destination": { 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_destination", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.219 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email address to send alerts to", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_from_name": { 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_from_name", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "Ceph", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.220 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email From: name", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_host": { 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_host", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.221 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP server", 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_password": { 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_password", 2024-09-05T07:54:41.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Password to authenticate with", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_port": { 2024-09-05T07:54:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_port", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "465", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP port", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_sender": { 2024-09-05T07:54:41.224 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_sender", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP envelope sender", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_ssl": { 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_ssl", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.226 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_user": { 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_user", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.227 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "User to authenticate as", 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "balancer", 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.228 INFO:teuthology.orchestra.run.smithi144.stdout: "active": { 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "active", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.229 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_time": { 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_time", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0000", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:41.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_weekday": { 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_weekday", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.231 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_max_iterations": { 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_max_iterations", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "25", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.232 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "250", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_metrics": { 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_metrics", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_step": { 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_step", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.5", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0.001", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "0.999", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "aggressiveness of optimization", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "end_time": { 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_time", 2024-09-05T07:54:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2359", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "end_weekday": { 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_weekday", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:41.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.238 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.239 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.240 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.243 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "min_score": { 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_score", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.244 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "upmap", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.245 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "crush-compat", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "none", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "read", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap-read" 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Balancer mode", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.246 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_ids": { 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_ids", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.248 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_deviation": { 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_deviation", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.249 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_optimizations": { 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_optimizations", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm", 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_down_multiplier": { 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_down_multiplier", 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.251 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_refresh_rate": { 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_refresh_rate", 2024-09-05T07:54:41.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "20", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_starting_port": { 2024-09-05T07:54:41.253 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_starting_port", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4721", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_ptrace": { 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_ptrace", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T07:54:41.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_interval": { 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_interval", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T07:54:41.256 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_memory_target_ratio": { 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.7", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm_log_destination": { 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm_log_destination", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "file", 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "file,syslog", 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "syslog" 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.259 INFO:teuthology.orchestra.run.smithi144.stdout: "cgroups_split": { 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cgroups_split", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.260 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "config_checks_enabled": { 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_checks_enabled", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.261 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "config_dashboard": { 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_dashboard", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T07:54:41.262 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_alertmanager": { 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_alertmanager", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.263 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_base": { 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_base", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.264 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Container image name, without the tag", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_elasticsearch": { 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_elasticsearch", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.265 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "elasticsearch container image", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_grafana": { 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_grafana", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.266 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_haproxy": { 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_haproxy", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.267 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "HAproxy container image", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_agent": { 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_agent", 2024-09-05T07:54:41.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger agent container image", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.269 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_collector": { 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_collector", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger collector container image", 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_query": { 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_query", 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger query container image", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_keepalived": { 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_keepalived", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.272 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Keepalived container image", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_loki": { 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_loki", 2024-09-05T07:54:41.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Loki container image", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.274 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_node_exporter": { 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_node_exporter", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_nvmeof": { 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_nvmeof", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Nvme-of container image", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_prometheus": { 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_prometheus", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.277 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_promtail": { 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_promtail", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.278 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Promtail container image", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_samba": { 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_samba", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.279 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Samba/SMB container image", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_snmp_gateway": { 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_snmp_gateway", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.280 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SNMP Gateway container image", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "container_init": { 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_init", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.281 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "daemon_cache_timeout": { 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "daemon_cache_timeout", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "default_cephadm_command_timeout": { 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.283 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "900", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "default_registry": { 2024-09-05T07:54:41.284 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_registry", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.285 INFO:teuthology.orchestra.run.smithi144.stdout: "device_cache_timeout": { 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_cache_timeout", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1800", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache device inventory", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "device_enhanced_scan": { 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_enhanced_scan", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.287 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "facts_cache_timeout": { 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "facts_cache_timeout", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache host facts data", 2024-09-05T07:54:41.288 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "grafana_dashboards_path": { 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "grafana_dashboards_path", 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T07:54:41.289 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "host_check_interval": { 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "host_check_interval", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to perform a host check", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "hw_monitoring": { 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hw_monitoring", 2024-09-05T07:54:41.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "inventory_list_all": { 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "inventory_list_all", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T07:54:41.293 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.294 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.295 INFO:teuthology.orchestra.run.smithi144.stdout: "log_refresh_metadata": { 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_refresh_metadata", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T07:54:41.296 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.297 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.298 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.301 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "*", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.302 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "max_count_per_host": { 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_count_per_host", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.303 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of daemons per service per host", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "max_osd_draining_count": { 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_osd_draining_count", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.304 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "migration_current": { 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "migration_current", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "internal - do not modify", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "root", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm-package", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "root" 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.307 INFO:teuthology.orchestra.run.smithi144.stdout: "oob_default_addr": { 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "oob_default_addr", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "169.254.1.1", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "prometheus_alerts_path": { 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus_alerts_path", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_insecure": { 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_insecure", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.310 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_password": { 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_password", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T07:54:41.311 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_url": { 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_url", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.312 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_username": { 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_username", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.313 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "secure_monitoring_stack": { 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "secure_monitoring_stack", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.314 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "service_discovery_port": { 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "service_discovery_port", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8765", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.315 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "cephadm service discovery port", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "ssh_config_file": { 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssh_config_file", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.316 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "use_agent": { 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_agent", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "use_repo_digest": { 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_repo_digest", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_failed_host_check": { 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_failed_host_check", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_daemons": { 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_daemons", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.320 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_hosts": { 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_hosts", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.321 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.322 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crash", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.323 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.324 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.326 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.328 INFO:teuthology.orchestra.run.smithi144.stdout: "retain_interval": { 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retain_interval", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "31536000", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_recent_interval": { 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_recent_interval", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1209600", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T07:54:41.330 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dashboard", 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T07:54:41.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T07:54:41.332 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.333 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_ENABLED": { 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.335 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.337 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.338 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.339 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.340 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T07:54:41.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T07:54:41.342 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.343 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.344 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.345 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.346 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T07:54:41.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.349 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_URL": { 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_URL", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.350 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.351 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.352 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.353 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.354 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T07:54:41.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T07:54:41.357 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.358 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.360 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.361 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.362 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.363 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T07:54:41.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T07:54:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T07:54:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.368 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.369 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "45", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.372 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.373 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.374 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T07:54:41.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T07:54:41.377 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.379 INFO:teuthology.orchestra.run.smithi144.stdout: "cross_origin_url": { 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cross_origin_url", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "crt_file": { 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crt_file", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "debug": { 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "debug", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.382 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable/disable debug options", 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "jwt_token_ttl": { 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "jwt_token_ttl", 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.383 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "28800", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.384 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.386 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.387 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.389 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.390 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "motd": { 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "motd", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.391 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "The message of the day", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect_resolve_ip_addr": { 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.393 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:41.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8080", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:41.395 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.396 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl_server_port": { 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl_server_port", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8443", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "redirect", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.398 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect" 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "url_prefix": { 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url_prefix", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.400 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_monitoring": { 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_monitoring", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.402 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "monitor device health metrics", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.403 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.405 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.406 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.407 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.408 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "mark_out_threshold": { 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mark_out_threshold", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2419200", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_name": { 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_name", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.410 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "device_health_metrics", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "retention_period": { 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retention_period", 2024-09-05T07:54:41.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15552000", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain device health metrics", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_frequency": { 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_frequency", 2024-09-05T07:54:41.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.413 INFO:teuthology.orchestra.run.smithi144.stdout: "self_heal": { 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "self_heal", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_threshold": { 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_threshold", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7257600", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.416 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "diskprediction_local", 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.418 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.419 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.420 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.421 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "predict_interval": { 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predict_interval", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "predictor_model": { 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predictor_model", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "prophetstor", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "influx", 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": false, 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "influxdb python module not found", 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "batch_size": { 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "batch_size", 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5000", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.427 INFO:teuthology.orchestra.run.smithi144.stdout: "database": { 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "database", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "ceph", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.428 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": { 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hostname", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.429 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server hostname", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "30", 2024-09-05T07:54:41.430 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "5", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.431 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.433 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.434 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "password": { 2024-09-05T07:54:41.436 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "password", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "password of InfluxDB server user", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.437 INFO:teuthology.orchestra.run.smithi144.stdout: "port": { 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "port", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8086", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server port", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.438 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "false", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "threads": { 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threads", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "32", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T07:54:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "username": { 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "username", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.441 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "username of InfluxDB server user", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "verify_ssl": { 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "verify_ssl", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "true", 2024-09-05T07:54:41.442 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "insights", 2024-09-05T07:54:41.443 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.444 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.445 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.446 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.447 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "iostat", 2024-09-05T07:54:41.449 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.450 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.451 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.453 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.454 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "k8sevents", 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_event_retention_days": { 2024-09-05T07:54:41.455 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ceph_event_retention_days", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: "config_check_secs": { 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_check_secs", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "10", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.457 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.458 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.461 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.462 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "localpool", 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "failure_domain": { 2024-09-05T07:54:41.463 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "failure_domain", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "host", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "failure domain for any created local pool", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.464 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.465 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.466 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "min_size": { 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_size", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.470 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default min_size for any created local pool", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "num_rep": { 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "num_rep", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3", 2024-09-05T07:54:41.471 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default replica count for any created local pool", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_num": { 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_num", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "128", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "prefix": { 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prefix", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.473 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name prefix for any created local pool", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "subtree": { 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subtree", 2024-09-05T07:54:41.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "rack", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mds_autoscaler", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.476 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.478 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.479 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.480 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirroring", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.482 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.483 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.484 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.485 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.487 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "nfs", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.488 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.491 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "fail_fs": { 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fail_fs", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.494 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.495 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.497 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.498 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator": { 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.500 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "rook", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "test_orchestrator" 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Orchestrator backend", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.501 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_perf_query", 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.502 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.503 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.504 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.505 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.506 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.507 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_support", 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.508 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.509 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.510 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.511 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.512 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.513 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_autoscaler", 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.515 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.516 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.518 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.519 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.520 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "threshold": { 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threshold", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.521 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1.0", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "scaling threshold", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "progress", 2024-09-05T07:54:41.522 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_pg_recovery_event": { 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_pg_recovery_event", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T07:54:41.523 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.524 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.525 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.526 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.528 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.529 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "max_completed_events": { 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_completed_events", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "50", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "number of past completed events to remember", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long the module is going to sleep", 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.532 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "cache": { 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cache", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.533 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "exclude_perf_counters": { 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "exclude_perf_counters", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.534 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.535 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.537 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.538 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.540 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools": { 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.541 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "300", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_interval": { 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_interval", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15.0", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.544 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "9283", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "stale_cache_strategy": { 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stale_cache_strategy", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "log", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.546 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "default", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.547 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "default", 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "error" 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.548 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.550 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.551 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.553 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_snap_create": { 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_snap_create", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "mirror_snapshot_schedule": { 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.556 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "trash_purge_schedule": { 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "trash_purge_schedule", 2024-09-05T07:54:41.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "restful", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_auth": { 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_auth", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.559 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.560 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.562 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.563 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.564 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.567 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.568 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rgw", 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.569 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.570 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.571 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.572 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.573 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rook", 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.576 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.577 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.579 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "storage_class": { 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "storage_class", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "local", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.581 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "selftest", 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.582 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.583 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.584 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.585 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.587 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "roption1": { 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption1", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.588 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "roption2": { 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption2", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "xyz", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.589 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption1": { 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption1", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.590 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption2": { 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption2", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.591 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption3": { 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption3", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.592 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption4": { 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption4", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption5": { 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption5", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.594 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption6": { 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption6", 2024-09-05T07:54:41.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption7": { 2024-09-05T07:54:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption7", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "42", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "testkey": { 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testkey", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.598 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "testlkey": { 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testlkey", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "testnewline": { 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testnewline", 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.600 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snap_schedule", 2024-09-05T07:54:41.601 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_m_granularity": { 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_m_granularity", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.602 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "dump_on_update": { 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dump_on_update", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.603 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "dump database to debug log on update", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.605 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.607 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.608 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stats", 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.610 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.613 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.614 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.615 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "status", 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.616 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.617 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.619 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.620 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.621 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telegraf", 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "address": { 2024-09-05T07:54:41.622 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "address", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.624 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.625 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.628 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.629 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telemetry", 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.630 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_basic": { 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_basic", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_crash": { 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_crash", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_device": { 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_device", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.633 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_ident": { 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_ident", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.634 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_perf": { 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_perf", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.635 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "contact": { 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "contact", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.636 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": { 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "description", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "device_url": { 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_url", 2024-09-05T07:54:41.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:41.639 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "24", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "8", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "last_opt_revision": { 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "last_opt_revision", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard": { 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.643 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard_description": { 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard_description", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.644 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.645 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.647 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.648 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.649 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "organization": { 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "organization", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.650 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "proxy": { 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "proxy", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.651 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "url": { 2024-09-05T07:54:41.652 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "test_orchestrator", 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.654 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.656 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.657 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.658 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.661 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.662 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.666 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.667 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.668 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_clones": { 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_clones", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.669 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "periodic_async_work": { 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "periodic_async_work", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.670 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Periodically check for async work", 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_delay": { 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_delay", 2024-09-05T07:54:41.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_no_wait": { 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.673 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix", 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "discovery_interval": { 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "discovery_interval", 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.674 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "100", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "identifier": { 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "identifier", 2024-09-05T07:54:41.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.676 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.677 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.678 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.679 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.681 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.682 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_host": { 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_host", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.683 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_port": { 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_port", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10051", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.684 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_sender": { 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_sender", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.685 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 24110, 2024-09-05T07:54:41.686 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "y", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr_features": 4540701547738038271, 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "available_modules": [ 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "alerts", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.687 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.689 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.690 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.691 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.692 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_destination": { 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_destination", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email address to send alerts to", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_from_name": { 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_from_name", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "Ceph", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email From: name", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_host": { 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_host", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP server", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_password": { 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_password", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Password to authenticate with", 2024-09-05T07:54:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_port": { 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_port", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "465", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP port", 2024-09-05T07:54:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_sender": { 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_sender", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP envelope sender", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_ssl": { 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_ssl", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_user": { 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_user", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "User to authenticate as", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "balancer", 2024-09-05T07:54:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "active": { 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "active", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T07:54:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_time": { 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_time", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0000", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_weekday": { 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_weekday", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_max_iterations": { 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_max_iterations", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "25", 2024-09-05T07:54:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "250", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_metrics": { 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_metrics", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_step": { 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_step", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.5", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0.001", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "0.999", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "aggressiveness of optimization", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "end_time": { 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_time", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2359", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "end_weekday": { 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_weekday", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "min_score": { 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_score", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T07:54:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "upmap", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "crush-compat", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "none", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "read", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap-read" 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Balancer mode", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_ids": { 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_ids", 2024-09-05T07:54:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_deviation": { 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_deviation", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_optimizations": { 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_optimizations", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm", 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_down_multiplier": { 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_down_multiplier", 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_refresh_rate": { 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_refresh_rate", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "20", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_starting_port": { 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_starting_port", 2024-09-05T07:54:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4721", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_ptrace": { 2024-09-05T07:54:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_ptrace", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_interval": { 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_interval", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_memory_target_ratio": { 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.7", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm_log_destination": { 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm_log_destination", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "file", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "file,syslog", 2024-09-05T07:54:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "syslog" 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "cgroups_split": { 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cgroups_split", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "config_checks_enabled": { 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_checks_enabled", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "config_dashboard": { 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_dashboard", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_alertmanager": { 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_alertmanager", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_base": { 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_base", 2024-09-05T07:54:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Container image name, without the tag", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_elasticsearch": { 2024-09-05T07:54:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_elasticsearch", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "elasticsearch container image", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_grafana": { 2024-09-05T07:54:41.738 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_grafana", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.739 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_haproxy": { 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_haproxy", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "HAproxy container image", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.740 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_agent": { 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_agent", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger agent container image", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.741 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_collector": { 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_collector", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger collector container image", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.742 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_query": { 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_query", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger query container image", 2024-09-05T07:54:41.743 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_keepalived": { 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_keepalived", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.744 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Keepalived container image", 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_loki": { 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_loki", 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Loki container image", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_node_exporter": { 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_node_exporter", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_nvmeof": { 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_nvmeof", 2024-09-05T07:54:41.747 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Nvme-of container image", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_prometheus": { 2024-09-05T07:54:41.748 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_prometheus", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.749 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_promtail": { 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_promtail", 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Promtail container image", 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_samba": { 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_samba", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Samba/SMB container image", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.752 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_snmp_gateway": { 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_snmp_gateway", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SNMP Gateway container image", 2024-09-05T07:54:41.753 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "container_init": { 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_init", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T07:54:41.754 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "daemon_cache_timeout": { 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "daemon_cache_timeout", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.755 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "default_cephadm_command_timeout": { 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "900", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "default_registry": { 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_registry", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io", 2024-09-05T07:54:41.757 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "device_cache_timeout": { 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_cache_timeout", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.758 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1800", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache device inventory", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "device_enhanced_scan": { 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_enhanced_scan", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.759 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "facts_cache_timeout": { 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "facts_cache_timeout", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.760 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache host facts data", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "grafana_dashboards_path": { 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "grafana_dashboards_path", 2024-09-05T07:54:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "host_check_interval": { 2024-09-05T07:54:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "host_check_interval", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to perform a host check", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.763 INFO:teuthology.orchestra.run.smithi144.stdout: "hw_monitoring": { 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hw_monitoring", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "inventory_list_all": { 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "inventory_list_all", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.765 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.766 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "log_refresh_metadata": { 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_refresh_metadata", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.767 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.773 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "*", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "max_count_per_host": { 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_count_per_host", 2024-09-05T07:54:41.774 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of daemons per service per host", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "max_osd_draining_count": { 2024-09-05T07:54:41.775 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_osd_draining_count", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: "migration_current": { 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "migration_current", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "internal - do not modify", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "root", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm-package", 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "root" 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.778 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "oob_default_addr": { 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "oob_default_addr", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "169.254.1.1", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.779 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "prometheus_alerts_path": { 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus_alerts_path", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T07:54:41.780 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_insecure": { 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_insecure", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.781 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_password": { 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_password", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_url": { 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_url", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.783 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_username": { 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_username", 2024-09-05T07:54:41.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "secure_monitoring_stack": { 2024-09-05T07:54:41.785 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "secure_monitoring_stack", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.786 INFO:teuthology.orchestra.run.smithi144.stdout: "service_discovery_port": { 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "service_discovery_port", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8765", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "cephadm service discovery port", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "ssh_config_file": { 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssh_config_file", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.788 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "use_agent": { 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_agent", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.789 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "use_repo_digest": { 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_repo_digest", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T07:54:41.790 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_failed_host_check": { 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_failed_host_check", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.791 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_daemons": { 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_daemons", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.792 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_hosts": { 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_hosts", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.793 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crash", 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.794 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.795 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.797 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.798 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.799 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "retain_interval": { 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retain_interval", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.800 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "31536000", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_recent_interval": { 2024-09-05T07:54:41.801 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_recent_interval", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1209600", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dashboard", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.803 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.805 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_ENABLED": { 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T07:54:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T07:54:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T07:54:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_URL": { 2024-09-05T07:54:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_URL", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T07:54:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T07:54:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T07:54:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T07:54:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T07:54:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8", 2024-09-05T07:54:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "45", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T07:54:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T07:54:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "cross_origin_url": { 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cross_origin_url", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "crt_file": { 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crt_file", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "debug": { 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "debug", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable/disable debug options", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "jwt_token_ttl": { 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "jwt_token_ttl", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "28800", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "motd": { 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "motd", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "The message of the day", 2024-09-05T07:54:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect_resolve_ip_addr": { 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8080", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl_server_port": { 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl_server_port", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8443", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "redirect", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect" 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "url_prefix": { 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url_prefix", 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_monitoring": { 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_monitoring", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "monitor device health metrics", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "mark_out_threshold": { 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mark_out_threshold", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2419200", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_name": { 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_name", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "device_health_metrics", 2024-09-05T07:54:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "retention_period": { 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retention_period", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15552000", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain device health metrics", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_frequency": { 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_frequency", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "self_heal": { 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "self_heal", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_threshold": { 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_threshold", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7257600", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "diskprediction_local", 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "predict_interval": { 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predict_interval", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "predictor_model": { 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predictor_model", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "prophetstor", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "influx", 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": false, 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "influxdb python module not found", 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "batch_size": { 2024-09-05T07:54:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "batch_size", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5000", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "database": { 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "database", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "ceph", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": { 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hostname", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server hostname", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "30", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "5", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T07:54:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.910 INFO:teuthology.orchestra.run.smithi144.stdout: "password": { 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "password", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "password of InfluxDB server user", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "port": { 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "port", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8086", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server port", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.912 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "false", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.913 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "threads": { 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threads", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "32", 2024-09-05T07:54:41.914 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "username": { 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "username", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.915 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "username of InfluxDB server user", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "verify_ssl": { 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "verify_ssl", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.916 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "true", 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "insights", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.918 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.920 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.921 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "iostat", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.925 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "k8sevents", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_event_retention_days": { 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ceph_event_retention_days", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "config_check_secs": { 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_check_secs", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.931 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "10", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.933 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.935 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.936 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.937 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "localpool", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "failure_domain": { 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "failure_domain", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "host", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.939 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "failure domain for any created local pool", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.941 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.942 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.943 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.945 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "min_size": { 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_size", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default min_size for any created local pool", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T07:54:41.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "num_rep": { 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "num_rep", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default replica count for any created local pool", 2024-09-05T07:54:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_num": { 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_num", 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "128", 2024-09-05T07:54:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "prefix": { 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prefix", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name prefix for any created local pool", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "subtree": { 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subtree", 2024-09-05T07:54:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "rack", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mds_autoscaler", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirroring", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "nfs", 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "fail_fs": { 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fail_fs", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator": { 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "rook", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "test_orchestrator" 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Orchestrator backend", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_perf_query", 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_support", 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_autoscaler", 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "threshold": { 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threshold", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1.0", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "scaling threshold", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "progress", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_pg_recovery_event": { 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_pg_recovery_event", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "max_completed_events": { 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_completed_events", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "50", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "number of past completed events to remember", 2024-09-05T07:54:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long the module is going to sleep", 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus", 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "cache": { 2024-09-05T07:54:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cache", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "exclude_perf_counters": { 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "exclude_perf_counters", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools": { 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "300", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_interval": { 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_interval", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15.0", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T07:54:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "9283", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T07:54:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "stale_cache_strategy": { 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stale_cache_strategy", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "log", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "default", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "default", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "error" 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_snap_create": { 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_snap_create", 2024-09-05T07:54:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "mirror_snapshot_schedule": { 2024-09-05T07:54:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "trash_purge_schedule": { 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "trash_purge_schedule", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "restful", 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_auth": { 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_auth", 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rgw", 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rook", 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "storage_class": { 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "storage_class", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "local", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "selftest", 2024-09-05T07:54:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "roption1": { 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption1", 2024-09-05T07:54:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "roption2": { 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption2", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "xyz", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption1": { 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption1", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption2": { 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption2", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption3": { 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption3", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption4": { 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption4", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption5": { 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption5", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption6": { 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption6", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption7": { 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption7", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "42", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "testkey": { 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testkey", 2024-09-05T07:54:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "testlkey": { 2024-09-05T07:54:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testlkey", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "testnewline": { 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testnewline", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snap_schedule", 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_m_granularity": { 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_m_granularity", 2024-09-05T07:54:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "dump_on_update": { 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dump_on_update", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "dump database to debug log on update", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stats", 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "status", 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telegraf", 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "address": { 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "address", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telemetry", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_basic": { 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_basic", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_crash": { 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_crash", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_device": { 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_device", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_ident": { 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_ident", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_perf": { 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_perf", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "contact": { 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "contact", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "description": { 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "description", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "device_url": { 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_url", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "24", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "8", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "last_opt_revision": { 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "last_opt_revision", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard": { 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard_description": { 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard_description", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "organization": { 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "organization", 2024-09-05T07:54:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "proxy": { 2024-09-05T07:54:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "proxy", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "url": { 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "test_orchestrator", 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_clones": { 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_clones", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "periodic_async_work": { 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "periodic_async_work", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Periodically check for async work", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_delay": { 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_delay", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_no_wait": { 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T07:54:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix", 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "discovery_interval": { 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "discovery_interval", 2024-09-05T07:54:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "100", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "identifier": { 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "identifier", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_host": { 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_host", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_port": { 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_port", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10051", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_sender": { 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_sender", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "dashboard", 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "available_modules": [ 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "alerts", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_destination": { 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_destination", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email address to send alerts to", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_from_name": { 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_from_name", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "Ceph", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email From: name", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_host": { 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_host", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP server", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_password": { 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_password", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Password to authenticate with", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_port": { 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_port", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "465", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP port", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_sender": { 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_sender", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP envelope sender", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_ssl": { 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_ssl", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_user": { 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_user", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "User to authenticate as", 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "balancer", 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "active": { 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "active", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_time": { 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_time", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0000", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_weekday": { 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_weekday", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T07:54:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_max_iterations": { 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_max_iterations", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "25", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "250", 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_metrics": { 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_metrics", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_step": { 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_step", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.5", 2024-09-05T07:54:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0.001", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "0.999", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "aggressiveness of optimization", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "end_time": { 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_time", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2359", 2024-09-05T07:54:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "end_weekday": { 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_weekday", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "min_score": { 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_score", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "upmap", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "crush-compat", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "none", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "read", 2024-09-05T07:54:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap-read" 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Balancer mode", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_ids": { 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_ids", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_deviation": { 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_deviation", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_optimizations": { 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_optimizations", 2024-09-05T07:54:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_down_multiplier": { 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_down_multiplier", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_refresh_rate": { 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_refresh_rate", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "20", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_starting_port": { 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_starting_port", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4721", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_ptrace": { 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_ptrace", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_interval": { 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_interval", 2024-09-05T07:54:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_memory_target_ratio": { 2024-09-05T07:54:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.7", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm_log_destination": { 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm_log_destination", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "file", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "file,syslog", 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "syslog" 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "cgroups_split": { 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cgroups_split", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "config_checks_enabled": { 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_checks_enabled", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "config_dashboard": { 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_dashboard", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_alertmanager": { 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_alertmanager", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_base": { 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_base", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Container image name, without the tag", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_elasticsearch": { 2024-09-05T07:54:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_elasticsearch", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "elasticsearch container image", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_grafana": { 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_grafana", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_haproxy": { 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_haproxy", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "HAproxy container image", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_agent": { 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_agent", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger agent container image", 2024-09-05T07:54:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_collector": { 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_collector", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger collector container image", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_query": { 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_query", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger query container image", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_keepalived": { 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_keepalived", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T07:54:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Keepalived container image", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_loki": { 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_loki", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Loki container image", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_node_exporter": { 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_node_exporter", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_nvmeof": { 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_nvmeof", 2024-09-05T07:54:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Nvme-of container image", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_prometheus": { 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_prometheus", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_promtail": { 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_promtail", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Promtail container image", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_samba": { 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_samba", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Samba/SMB container image", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_snmp_gateway": { 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_snmp_gateway", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SNMP Gateway container image", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "container_init": { 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_init", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "daemon_cache_timeout": { 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "daemon_cache_timeout", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "default_cephadm_command_timeout": { 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T07:54:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "900", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "default_registry": { 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_registry", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "device_cache_timeout": { 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_cache_timeout", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1800", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache device inventory", 2024-09-05T07:54:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "device_enhanced_scan": { 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_enhanced_scan", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "facts_cache_timeout": { 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "facts_cache_timeout", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache host facts data", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "grafana_dashboards_path": { 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "grafana_dashboards_path", 2024-09-05T07:54:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "host_check_interval": { 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "host_check_interval", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to perform a host check", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "hw_monitoring": { 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hw_monitoring", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T07:54:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "inventory_list_all": { 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "inventory_list_all", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "log_refresh_metadata": { 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_refresh_metadata", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "*", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "max_count_per_host": { 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_count_per_host", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of daemons per service per host", 2024-09-05T07:54:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "max_osd_draining_count": { 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_osd_draining_count", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "migration_current": { 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "migration_current", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "internal - do not modify", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "root", 2024-09-05T07:54:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm-package", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "root" 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "oob_default_addr": { 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "oob_default_addr", 2024-09-05T07:54:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "169.254.1.1", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "prometheus_alerts_path": { 2024-09-05T07:54:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus_alerts_path", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_insecure": { 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_insecure", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_password": { 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_password", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_url": { 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_url", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T07:54:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_username": { 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_username", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "secure_monitoring_stack": { 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "secure_monitoring_stack", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "service_discovery_port": { 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "service_discovery_port", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8765", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "cephadm service discovery port", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "ssh_config_file": { 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssh_config_file", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "use_agent": { 2024-09-05T07:54:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_agent", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "use_repo_digest": { 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_repo_digest", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T07:54:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_failed_host_check": { 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_failed_host_check", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_daemons": { 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_daemons", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_hosts": { 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_hosts", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crash", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "retain_interval": { 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retain_interval", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "31536000", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_recent_interval": { 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_recent_interval", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1209600", 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dashboard", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T07:54:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_ENABLED": { 2024-09-05T07:54:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T07:54:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_URL": { 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_URL", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T07:54:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T07:54:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T07:54:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T07:54:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T07:54:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "45", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-05T07:54:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T07:54:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T07:54:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "cross_origin_url": { 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cross_origin_url", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "crt_file": { 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crt_file", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "debug": { 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "debug", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable/disable debug options", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "jwt_token_ttl": { 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "jwt_token_ttl", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "28800", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "motd": { 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "motd", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "The message of the day", 2024-09-05T07:54:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect_resolve_ip_addr": { 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8080", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl_server_port": { 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl_server_port", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8443", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "redirect", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect" 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "url_prefix": { 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url_prefix", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_monitoring": { 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_monitoring", 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "monitor device health metrics", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mark_out_threshold": { 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mark_out_threshold", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2419200", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_name": { 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_name", 2024-09-05T07:54:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "device_health_metrics", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "retention_period": { 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retention_period", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15552000", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain device health metrics", 2024-09-05T07:54:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_frequency": { 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_frequency", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "self_heal": { 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "self_heal", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_threshold": { 2024-09-05T07:54:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_threshold", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7257600", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "diskprediction_local", 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "predict_interval": { 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predict_interval", 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-05T07:54:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "predictor_model": { 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predictor_model", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "prophetstor", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "influx", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": false, 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "influxdb python module not found", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "batch_size": { 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "batch_size", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5000", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "database": { 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "database", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "ceph", 2024-09-05T07:54:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": { 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hostname", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server hostname", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "30", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "5", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "password": { 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "password", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "password of InfluxDB server user", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "port": { 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "port", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8086", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server port", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "false", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "threads": { 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threads", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "32", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "username": { 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "username", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "username of InfluxDB server user", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "verify_ssl": { 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "verify_ssl", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "true", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "insights", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "iostat", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "k8sevents", 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_event_retention_days": { 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ceph_event_retention_days", 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "config_check_secs": { 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_check_secs", 2024-09-05T07:54:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "10", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "localpool", 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "failure_domain": { 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "failure_domain", 2024-09-05T07:54:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "host", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "failure domain for any created local pool", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "min_size": { 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_size", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default min_size for any created local pool", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "num_rep": { 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "num_rep", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default replica count for any created local pool", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_num": { 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_num", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "128", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "prefix": { 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prefix", 2024-09-05T07:54:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name prefix for any created local pool", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "subtree": { 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subtree", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "rack", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T07:54:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mds_autoscaler", 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirroring", 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "nfs", 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "fail_fs": { 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fail_fs", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator": { 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "rook", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "test_orchestrator" 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Orchestrator backend", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_perf_query", 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_support", 2024-09-05T07:54:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_autoscaler", 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "threshold": { 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threshold", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1.0", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "scaling threshold", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "progress", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_pg_recovery_event": { 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_pg_recovery_event", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "max_completed_events": { 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_completed_events", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "50", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "number of past completed events to remember", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long the module is going to sleep", 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus", 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "cache": { 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cache", 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "exclude_perf_counters": { 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "exclude_perf_counters", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools": { 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "300", 2024-09-05T07:54:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_interval": { 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_interval", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15.0", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "9283", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "stale_cache_strategy": { 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stale_cache_strategy", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "log", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "default", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "default", 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "error" 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-05T07:54:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_snap_create": { 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_snap_create", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "mirror_snapshot_schedule": { 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "trash_purge_schedule": { 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "trash_purge_schedule", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "restful", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_auth": { 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_auth", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rgw", 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rook", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "storage_class": { 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "storage_class", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "local", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "selftest", 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "roption1": { 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption1", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "roption2": { 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption2", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "xyz", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption1": { 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption1", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption2": { 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption2", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption3": { 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption3", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption4": { 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption4", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.553 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption5": { 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption5", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption6": { 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption6", 2024-09-05T07:54:42.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.556 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption7": { 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption7", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "42", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "testkey": { 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testkey", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.558 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "testlkey": { 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testlkey", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "testnewline": { 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testnewline", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.560 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snap_schedule", 2024-09-05T07:54:42.561 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_m_granularity": { 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_m_granularity", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T07:54:42.562 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "dump_on_update": { 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dump_on_update", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.563 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "dump database to debug log on update", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.564 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.566 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.569 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stats", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.570 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.571 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.572 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.573 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.575 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "status", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.576 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.579 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.580 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telegraf", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "address": { 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "address", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T07:54:42.582 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.583 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.585 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.586 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.587 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.588 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.589 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telemetry", 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_basic": { 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_basic", 2024-09-05T07:54:42.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.591 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_crash": { 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_crash", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_device": { 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_device", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.593 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_ident": { 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_ident", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.594 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_perf": { 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_perf", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "contact": { 2024-09-05T07:54:42.596 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "contact", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": { 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "description", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.598 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "device_url": { 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_url", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.599 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "24", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "8", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "last_opt_revision": { 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "last_opt_revision", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard": { 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard_description": { 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard_description", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "organization": { 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "organization", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "proxy": { 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "proxy", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "url": { 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "test_orchestrator", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_clones": { 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_clones", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4", 2024-09-05T07:54:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "periodic_async_work": { 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "periodic_async_work", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Periodically check for async work", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_delay": { 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_delay", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_no_wait": { 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T07:54:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix", 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-05T07:54:42.632 INFO:teuthology.orchestra.run.smithi144.stdout: "discovery_interval": { 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "discovery_interval", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "100", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.633 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "identifier": { 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "identifier", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.635 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.636 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.637 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.638 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-05T07:54:42.639 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-05T07:54:42.640 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.641 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_host": { 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_host", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.642 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_port": { 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_port", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10051", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_sender": { 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_sender", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-05T07:54:42.644 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "services": { 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "dashboard": "https://172.21.15.144:8443/" 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "always_on_modules": { 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "octopus": [ 2024-09-05T07:54:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "pacific": [ 2024-09-05T07:54:42.646 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "quincy": [ 2024-09-05T07:54:42.647 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "reef": [ 2024-09-05T07:54:42.648 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-05T07:54:42.649 INFO:teuthology.orchestra.run.smithi144.stdout: "squid": [ 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.650 INFO:teuthology.orchestra.run.smithi144.stdout: "last_failure_osd_epoch": 3, 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "active_clients": [ 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 1926976677 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.651 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "libcephsqlite", 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 1108035631 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 3727716755 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-05T07:54:42.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 3832648059 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-05T07:54:42.654 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:54:42.655 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:41 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/424779056' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.655 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:41 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4067737962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.656 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:41 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2257356823' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T07:54:42.656 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:41 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/424779056' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.656 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:41 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4067737962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.656 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:41 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2257356823' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 msgr2=0x7f33d80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 0x7f33d80a5050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f33e00314e0 tx=0x7f33e0000bc0 comp rx=0 tx=0).stop 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 msgr2=0x7f33f4199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33e400e9c0 tx=0x7f33e400ee80 comp rx=0 tx=0).stop 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 shutdown_connections 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f33d80a2b90 0x7f33d80a5050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f4105720 0x7f33f41a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33f4104d60 0x7f33f419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 --2- 172.21.15.144:0/2257356823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33f4103b70 0x7f33f4199ee0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:54:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 >> 172.21.15.144:0/2257356823 conn(0x7f33f40ff2f0 msgr2=0x7f33f4108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:54:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 shutdown_connections 2024-09-05T07:54:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:54:41.205+0000 7f33f9200640 1 -- 172.21.15.144:0/2257356823 wait complete. 2024-09-05T07:54:42.720 DEBUG:tasks.check_counter:Getting stats from a 2024-09-05T07:54:42.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-05T07:54:42.721 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/424779056' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.721 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4067737962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T07:54:42.721 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:41 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2257356823' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T07:54:42.722 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:42 smithi154 ceph-mon[34710]: pgmap v453: 97 pgs: 97 active+clean; 5.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 111 op/s 2024-09-05T07:54:42.774 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:42 smithi144 ceph-mon[29535]: pgmap v453: 97 pgs: 97 active+clean; 5.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 111 op/s 2024-09-05T07:54:42.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:42 smithi175 ceph-mon[34585]: pgmap v453: 97 pgs: 97 active+clean; 5.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 111 op/s 2024-09-05T07:54:43.109 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 296, 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 338, 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 818606, 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 126454, 2024-09-05T07:54:43.899 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.053321709, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.017760303, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.036414340, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.002201613, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 340, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.042734211, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000125688 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:43.900 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 320, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000073629, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000230 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 776560, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 64384 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 17, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 88, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 4236, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 240723, 2024-09-05T07:54:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.014236177, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.005948154, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.006263537, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000820966, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 86, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.036513428, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000424574 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:43.902 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000306, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000153 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 203920 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 19, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 23, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 4912, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 31628, 2024-09-05T07:54:43.903 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 9, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 7, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.005667365, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000601425, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.004307253, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000285220, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 19, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.014422214, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000759063 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 13, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000001859, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000143 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-05T07:54:43.905 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 34, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.002277289, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000066979 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-05T07:54:43.906 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-05T07:54:43.907 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000032761, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000016380 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 2, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 1, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000216771, 2024-09-05T07:54:43.908 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000216771 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 1, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 11, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 11, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 11, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:43.909 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 10, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 4, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 2, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 1, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-05T07:54:43.910 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 5, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 10737418474, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:43.911 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:43.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 1 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 2, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-05T07:54:43.913 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 4, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 4, 2024-09-05T07:54:43.915 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 2, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4195426, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-05T07:54:43.916 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.006024090, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002008030 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 14, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 14, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 12, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-05T07:54:43.917 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 1, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 11, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 11, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 1, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 1, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 48852, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 223520 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 3, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 2, 2024-09-05T07:54:43.918 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 4, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000216771, 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000216771 2024-09-05T07:54:43.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.920 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.922 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.923 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-05T07:54:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-05T07:54:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 0, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 0, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 1, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 1, 2024-09-05T07:54:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 89, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 230375, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 71, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 157, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 55080, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 213, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 38, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 11334, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 33, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 38, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 38, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.269995476, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.007105144 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-05T07:54:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 38, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 60 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 38, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 0, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 38, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 10, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 0, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 3, 2024-09-05T07:54:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 6, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 6, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 20, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-05T07:54:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-05T07:54:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 85, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-05T07:54:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 14, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 1 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-05T07:54:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 328, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 787705, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 328, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 328, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 787705, 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 38, 2024-09-05T07:54:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 11334, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 38, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 11334, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-05T07:54:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 38, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 38, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 38, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 38, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-05T07:54:43.948 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55f94dfd2960": { 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 4, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 1122, 2024-09-05T07:54:43.949 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 4, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 3, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1122, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:43.950 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:54:44.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:44 smithi144 ceph-mon[29535]: pgmap v454: 97 pgs: 97 active+clean; 737 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 212 op/s 2024-09-05T07:54:44.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:44 smithi154 ceph-mon[34710]: pgmap v454: 97 pgs: 97 active+clean; 737 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 212 op/s 2024-09-05T07:54:44.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:44 smithi175 ceph-mon[34585]: pgmap v454: 97 pgs: 97 active+clean; 737 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 212 op/s 2024-09-05T07:54:44.854 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-05T07:54:44.854 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-05T07:54:44.854 DEBUG:tasks.check_counter:Getting stats from d 2024-09-05T07:54:44.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-05T07:54:45.220 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 327, 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 327, 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 89363, 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 103226, 2024-09-05T07:54:45.825 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.038343625, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.010987710, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.011973124, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.009609500, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 326, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.027195465, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000083421 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.826 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 223, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 299, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 54794, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 275401, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:45.827 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.039453317, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.019503385, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.007796938, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.008888964, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 297, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.017944969, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000060420 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 204800 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 433, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 426, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 858240, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 163478, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.071912715, 2024-09-05T07:54:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.030691786, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.036372769, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.010796314, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 425, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.039332374, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000092546 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.830 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 751728, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 62672 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-05T07:54:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1477, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.043527142, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000029469 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:45.833 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-05T07:54:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-05T07:54:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-05T07:54:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 4, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-05T07:54:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4195426, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 4195285, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 4 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 3, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 3, 2024-09-05T07:54:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 1, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 1, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 47164, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 215328 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-05T07:54:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-05T07:54:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-05T07:54:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 0, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-05T07:54:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1054, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-05T07:54:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 190270, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 49, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 157, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 8512, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 13, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-05T07:54:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 862, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 862, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 862, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.761986874, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000883975 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 862, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 863 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 862, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 862, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 537, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 323, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-05T07:54:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-05T07:54:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 85, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-05T07:54:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 5, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 5, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-05T07:54:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 979, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 905372, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 979, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 979, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 905372, 2024-09-05T07:54:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 862, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 1127, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 862, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1127, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 862, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 862, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 862, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 862, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-05T07:54:45.876 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55dfc7c12be0": { 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:45.877 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:45.878 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:54:46.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:46 smithi154 ceph-mon[34710]: pgmap v455: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 223 op/s 2024-09-05T07:54:46.776 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:46 smithi144 ceph-mon[29535]: pgmap v455: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 223 op/s 2024-09-05T07:54:46.819 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-09-05T07:54:46.819 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-09-05T07:54:46.819 DEBUG:tasks.check_counter:Getting stats from g 2024-09-05T07:54:46.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-05T07:54:46.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:46 smithi175 ceph-mon[34585]: pgmap v455: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 223 op/s 2024-09-05T07:54:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 0, 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2, 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 0, 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 0, 2024-09-05T07:54:47.816 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.003209937, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000515364, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:47.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 106, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 99, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 722816, 2024-09-05T07:54:47.818 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 59040, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.025750340, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.009756154, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.022391059, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 99, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.016681387, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000168498 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:47.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 722816, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 59040 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 74, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 160, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 91568, 2024-09-05T07:54:47.820 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.010183059, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.007126382, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.001960198, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 72, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.011211923, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000155721 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:47.821 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 91568 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-05T07:54:47.822 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:47.823 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:47.824 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:47.825 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148823, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 27, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-05T07:54:47.826 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-05T07:54:47.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 928, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:47.828 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 103, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 705445, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 103, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:47.829 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 103, 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 705445, 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:47.830 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:54:48.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:48 smithi154 ceph-mon[34710]: pgmap v456: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 224 op/s 2024-09-05T07:54:48.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:48 smithi144 ceph-mon[29535]: pgmap v456: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 224 op/s 2024-09-05T07:54:48.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:48 smithi175 ceph-mon[34585]: pgmap v456: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 224 op/s 2024-09-05T07:54:48.900 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-05T07:54:48.900 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-05T07:54:48.900 DEBUG:tasks.check_counter:Getting stats from j 2024-09-05T07:54:48.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-05T07:54:49.273 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:54:49.840 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-05T07:54:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 4, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 4, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 3024, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 448, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.006243985, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000065884, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.003493355, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3, 2024-09-05T07:54:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.006159789, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002053263 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1, 2024-09-05T07:54:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 78, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 160, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 92272, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.009842174, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.007054242, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.001735384, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 76, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.005956993, 2024-09-05T07:54:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000078381 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 92272 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 109, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 104, 2024-09-05T07:54:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 722320, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 62768, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.026362827, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.010225542, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.023707611, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 103, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.011762483, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000114198 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 722320, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 62768 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-05T07:54:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:49.849 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:49.849 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:49.849 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:49.849 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148823, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 27, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-05T07:54:49.852 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 928, 2024-09-05T07:54:49.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 110, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 706992, 2024-09-05T07:54:49.854 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 110, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 110, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 706992, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-05T07:54:49.855 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-05T07:54:50.554 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:50 smithi144 ceph-mon[29535]: pgmap v457: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 226 op/s 2024-09-05T07:54:50.674 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-05T07:54:50.675 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-05T07:54:50.675 DEBUG:tasks.check_counter:Getting stats from b 2024-09-05T07:54:50.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-05T07:54:50.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:50 smithi154 ceph-mon[34710]: pgmap v457: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 226 op/s 2024-09-05T07:54:50.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:50 smithi175 ceph-mon[34585]: pgmap v457: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 226 op/s 2024-09-05T07:54:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:54:51.625 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-05T07:54:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2140, 2024-09-05T07:54:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1900, 2024-09-05T07:54:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1430430, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 832943, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 23, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.181925777, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.052173740, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.092823938, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.043839496, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1903, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.486368184, 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000255579 2024-09-05T07:54:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1138, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000226378, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000198 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1003200, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 204000 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2772, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2762, 2024-09-05T07:54:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 768233, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 1144744, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 13, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.170182912, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.050259032, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.053661646, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.056141033, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2757, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.100496265, 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000036451 2024-09-05T07:54:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 276, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000064531, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000233 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 210032 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2233, 2024-09-05T07:54:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2019, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 583452, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 1610567, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 28, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.168182213, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.053492845, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.065471869, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.047757223, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2017, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.284315736, 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000140959 2024-09-05T07:54:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 703, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000155948, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000221 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 34192, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 3920 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 686, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.127570302, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000185962 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4395, 2024-09-05T07:54:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.113806328, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000025894 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 52, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 52, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 52, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.062032982, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001192941 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-05T07:54:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 98, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 25, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 5, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 20, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 17, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-05T07:54:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 1, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 1, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 72, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 63, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-05T07:54:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 1, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 12, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 107, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 145, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 126, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 5, 2024-09-05T07:54:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 25 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 6, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 5, 2024-09-05T07:54:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 5, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 227, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 218, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 218, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 9, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 7, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 16, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 15, 2024-09-05T07:54:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 15, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 1, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 1, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 1, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4853483, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4885097, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 207, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.389429450, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001881301 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 23, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 28, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 5, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 18, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 20, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 24, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 33, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 9, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 1, 2024-09-05T07:54:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 20, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 19, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 53684, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 231712 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 72, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 52, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 15, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 7, 2024-09-05T07:54:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.006419361, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000917051 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 16, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.004172199, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000260762 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000474298, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000237149 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012376057, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001547007 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000195056, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000195056 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000759145, 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000379572 2024-09-05T07:54:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001924429, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000962214 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.008129486, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004064743 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001581600, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001581600 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-05T07:54:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.020690605, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002586325 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005310746, 2024-09-05T07:54:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001770248 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-05T07:54:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 8, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 8, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 204, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 319844, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 133, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 616, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 7, 2024-09-05T07:54:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 157, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 97618, 2024-09-05T07:54:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 717, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 5585, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 797663, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 37, 2024-09-05T07:54:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 5585, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5585, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 36.565003254, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006547001 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5585, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 5844 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 5585, 2024-09-05T07:54:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 5, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 5580, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 78, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 30, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 5, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 212, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 64, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-05T07:54:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 5124, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 60, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-05T07:54:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 85, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-05T07:54:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 254, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 17 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-05T07:54:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 3584, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 1, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 4612, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 5, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 7141, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 2102281, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 7141, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 7141, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2102281, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 5585, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 798168, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 5585, 2024-09-05T07:54:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 798168, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:51.671 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 5585, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 5585, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 5585, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 5585, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:51.672 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 5, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 505, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 5, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 5, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 505, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.673 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5573055fe960": { 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 227, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 690793, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 227, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:51.674 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 207, 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 690793, 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:51.675 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-05T07:54:52.651 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:52 smithi154 ceph-mon[34710]: pgmap v458: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 187 op/s 2024-09-05T07:54:52.678 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-05T07:54:52.678 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-05T07:54:52.678 DEBUG:tasks.check_counter:Getting stats from e 2024-09-05T07:54:52.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-05T07:54:52.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:52 smithi144 ceph-mon[29535]: pgmap v458: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 187 op/s 2024-09-05T07:54:52.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:52 smithi175 ceph-mon[34585]: pgmap v458: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 187 op/s 2024-09-05T07:54:52.974 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 886, 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 888, 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 254996, 2024-09-05T07:54:53.494 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 281755, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.070076623, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.022585560, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.017979381, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.023445677, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 886, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.028145669, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000031767 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:53.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 119, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 112, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 752556, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 64010, 2024-09-05T07:54:53.496 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 3, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.018970648, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.006767565, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.018250240, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000053486, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 111, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.007734735, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000069682 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:53.497 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 752000, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 63312 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 6, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 81, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 3452, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 207358, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-05T07:54:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.007137076, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.003267288, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.003049848, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000027360, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 80, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.009835407, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000122942 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 207040 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:53.500 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1539, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.037218882, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000024183 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.501 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-05T07:54:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-05T07:54:53.503 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:53.504 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:53.505 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-05T07:54:53.506 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:53.507 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-05T07:54:53.508 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 7, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-05T07:54:53.509 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196271, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4196130, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 7 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-05T07:54:53.510 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48208, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.511 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.512 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.513 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:53.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.516 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.518 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.519 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.520 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-05T07:54:53.523 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2792, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-05T07:54:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:53.526 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:53.527 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181154, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 45, 2024-09-05T07:54:53.528 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 157, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:53.529 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 889, 2024-09-05T07:54:53.530 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 889, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 889, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.465987289, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000524170 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 889, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 890 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.531 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 889, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 889, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 553, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 334, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-05T07:54:53.532 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-05T07:54:53.533 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-05T07:54:53.534 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 85, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-05T07:54:53.535 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-05T07:54:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1007, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 911407, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1007, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1007, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 911407, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 889, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1972, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 889, 2024-09-05T07:54:53.539 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1972, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:53.540 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 889, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 889, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 889, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 889, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.541 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.542 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x563c4214cb40": { 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:53.543 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:53.544 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-05T07:54:54.204 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-05T07:54:54.204 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-05T07:54:54.204 DEBUG:tasks.check_counter:Getting stats from h 2024-09-05T07:54:54.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-05T07:54:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:54:54.732 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:54 smithi154 ceph-mon[34710]: pgmap v459: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 126 op/s 2024-09-05T07:54:54.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:54 smithi144 ceph-mon[29535]: pgmap v459: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 126 op/s 2024-09-05T07:54:54.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:54 smithi175 ceph-mon[34585]: pgmap v459: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.2 KiB/s wr, 126 op/s 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 856, 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 849, 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1659723, 2024-09-05T07:54:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 297838, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.083422013, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.031362427, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.034051332, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.018584181, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 848, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.029284939, 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000034534 2024-09-05T07:54:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 751888, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 62832 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 9, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 82, 2024-09-05T07:54:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 4840, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 208026, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.007752652, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.003121704, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.003784099, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000120484, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 81, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012577236, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000155274 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 206688 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 326, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 328, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 80302, 2024-09-05T07:54:54.969 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 103675, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.027808674, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.007971811, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.006950336, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.010033558, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 326, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.011986365, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000036767 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.970 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:54.971 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1796, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.044607819, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000024837 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:54.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:54.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 21, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 6, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 15, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 12, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-05T07:54:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-05T07:54:54.975 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:54.976 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.977 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-05T07:54:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-05T07:54:54.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 227, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 16, 2024-09-05T07:54:54.980 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4853483, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4885097, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4884498, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 227 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-05T07:54:54.981 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 16, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 21, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 5, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 13, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 21, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 25, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 4, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48780, 2024-09-05T07:54:54.982 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-05T07:54:54.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.985 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.986 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-05T07:54:54.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-05T07:54:54.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-05T07:54:54.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.994 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2790, 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:54.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:54.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:54.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 189296, 2024-09-05T07:54:54.999 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 50, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 157, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:55.000 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 64642, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 295, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 1069, 2024-09-05T07:54:55.001 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 26, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 4, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 1069, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1069, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.436988097, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000408782 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1069, 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1070 2024-09-05T07:54:55.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 1069, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 1069, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 650, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 416, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-05T07:54:55.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 2, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-05T07:54:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-05T07:54:55.005 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 85, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 5, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 5, 2024-09-05T07:54:55.006 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-05T07:54:55.007 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:55.008 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1187, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1629074, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1187, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1187, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1629074, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:55.009 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1069, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 690803, 2024-09-05T07:54:55.010 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1069, 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 690803, 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.011 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1069, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1069, 2024-09-05T07:54:55.012 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1069, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1069, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:55.013 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x559c1ab08b40": { 2024-09-05T07:54:55.014 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:55.015 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:55.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:55.016 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-05T07:54:55.782 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-05T07:54:55.782 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-05T07:54:55.782 DEBUG:tasks.check_counter:Getting stats from k 2024-09-05T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-05T07:54:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 449, 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 442, 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 863296, 2024-09-05T07:54:56.562 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 170176, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.057848004, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.019105067, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.029960508, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.011399647, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 441, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.024456159, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000055456 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.563 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 753088, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 65872 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 570, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 648, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 149453, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 388911, 2024-09-05T07:54:56.564 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.140956713, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.017988136, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.105445203, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.013516823, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 647, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.214733872, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000331891 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.565 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 209184 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 4, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 6, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1629, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 1284, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:56.566 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.001569863, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.000069627, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.001286351, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000106703, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.003992837, 2024-09-05T07:54:56.567 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000998209 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-05T07:54:56.568 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1554, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.041692104, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000026828 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-05T07:54:56.569 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-05T07:54:56.571 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-05T07:54:56.572 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-05T07:54:56.573 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:56.574 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:56.575 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-05T07:54:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-05T07:54:56.577 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 7, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-05T07:54:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196271, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4196130, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.579 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 7 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-05T07:54:56.580 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 47808, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.581 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.582 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:56.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.585 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.586 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.587 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:56.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.590 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.593 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-05T07:54:56.594 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2796, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:56.595 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:56.596 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:56.597 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 197399, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 54, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-05T07:54:56.598 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 157, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-05T07:54:56.599 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-05T07:54:56.600 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 897, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 897, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 897, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.489986616, 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000546250 2024-09-05T07:54:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 897, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 898 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 897, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 897, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 559, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 336, 2024-09-05T07:54:56.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:56.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-05T07:54:56.604 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-05T07:54:56.605 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-05T07:54:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-05T07:54:56.607 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 85, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-05T07:54:56.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 6, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 6, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-05T07:54:56.609 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-05T07:54:56.610 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-05T07:54:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-05T07:54:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1019, 2024-09-05T07:54:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 913493, 2024-09-05T07:54:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1019, 2024-09-05T07:54:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1019, 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 913493, 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 897, 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1972, 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 897, 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1972, 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 897, 2024-09-05T07:54:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 897, 2024-09-05T07:54:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 897, 2024-09-05T07:54:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 897, 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55cfa2028b40": { 2024-09-05T07:54:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-05T07:54:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-05T07:54:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-05T07:54:56.627 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-05T07:54:56.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:56 smithi154 ceph-mon[34710]: pgmap v460: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 25 op/s 2024-09-05T07:54:56.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:56 smithi144 ceph-mon[29535]: pgmap v460: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 25 op/s 2024-09-05T07:54:56.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:56 smithi175 ceph-mon[34585]: pgmap v460: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 25 op/s 2024-09-05T07:54:57.370 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-05T07:54:57.370 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-05T07:54:57.370 DEBUG:tasks.check_counter:Getting stats from c 2024-09-05T07:54:57.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-05T07:54:57.630 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:54:58.202 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-05T07:54:58.202 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:58.202 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 21, 2024-09-05T07:54:58.202 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 23, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5221, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 57871, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 12, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.005189067, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000325672, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.003110248, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000352807, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 21, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.016711679, 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000795794 2024-09-05T07:54:58.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000339, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000084 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 167, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 154, 2024-09-05T07:54:58.204 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 777179, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 74231, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.025372864, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.007598291, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.026397554, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000341326, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 154, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.030457573, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000197776 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.205 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 773888, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 68560 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 108, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 271, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 32389, 2024-09-05T07:54:58.206 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 258651, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.024093694, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.010517639, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.008965878, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.002094592, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 269, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.022174108, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000082431 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:58.207 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 284, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000095555, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000336 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 208032 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:54:58.208 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 43, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001434387, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000033357 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000012498, 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000006249 2024-09-05T07:54:58.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:58.210 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 10, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 10, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 10, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 1, 2024-09-05T07:54:58.211 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-05T07:54:58.212 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 5, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 10737418474, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-05T07:54:58.214 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 1, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:58.215 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.216 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 2, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 2, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-05T07:54:58.217 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4194892, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001496112, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001496112 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.218 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 13, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 13, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 0, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 11, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 12, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 10, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 10, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-05T07:54:58.219 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 49424, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223520 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-09-05T07:54:58.220 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.221 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:58.222 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.224 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.225 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.225 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-05T07:54:58.225 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.225 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.229 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:58.230 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.231 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.232 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 0, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:58.235 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:58.236 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 229815, 2024-09-05T07:54:58.237 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 69, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 157, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:58.238 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 50872, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 198, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 35, 2024-09-05T07:54:58.239 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 10710, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 35, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 35, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.227996638, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006514189 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 35, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 57 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.240 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 35, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 35, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-05T07:54:58.241 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 1, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 5, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-05T07:54:58.244 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-05T07:54:58.245 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-05T07:54:58.246 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 85, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 8, 2024-09-05T07:54:58.247 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 8, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 14, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-05T07:54:58.248 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:58.249 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 292, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 777984, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 292, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:58.250 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 292, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 777984, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:58.251 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 35, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 10710, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 35, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 10710, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.252 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:58.253 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 35, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 35, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 35, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 35, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.254 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-05T07:54:58.255 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55652afe2960": { 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 588, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:58.256 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 588, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:58.257 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-05T07:54:58.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:54:58 smithi144 ceph-mon[29535]: pgmap v461: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T07:54:58.822 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:54:58 smithi175 ceph-mon[34585]: pgmap v461: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T07:54:58.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:54:58 smithi154 ceph-mon[34710]: pgmap v461: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T07:54:59.081 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-05T07:54:59.082 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-05T07:54:59.082 DEBUG:tasks.check_counter:Getting stats from f 2024-09-05T07:54:59.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-05T07:54:59.340 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 174, 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 165, 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 773054, 2024-09-05T07:54:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 102987, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 11, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.027554268, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.007980090, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.025231228, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000345701, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 163, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.019645573, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000120524 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:59.855 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 16, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000002737, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000171 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 769072, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 70512 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 109, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 271, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 33623, 2024-09-05T07:54:59.856 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 326535, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.024210406, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.010469795, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.009221523, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.002027409, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 271, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.026862515, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000099123 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:59.857 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 280, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000078114, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000278 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 208208 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 26, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 28, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 7005, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 35129, 2024-09-05T07:54:59.858 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.006524808, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000978539, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.004737294, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000543778, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 26, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.023319611, 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000896908 2024-09-05T07:54:59.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000001871, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000207 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1408, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 1120 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-05T07:54:59.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 55, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001469829, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000026724 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:54:59.861 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000019313, 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000009656 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 1, 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 1, 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-05T07:54:59.862 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000124716, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000124716 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 10, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-05T07:54:59.863 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 10, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 10, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 1, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 1, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 1, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:54:59.864 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 5, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 10737418474, 2024-09-05T07:54:59.865 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:54:59.866 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 1, 2024-09-05T07:54:59.867 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-05T07:54:59.868 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-05T07:54:59.869 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 7, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 7, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-05T07:54:59.870 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4196271, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.023287549, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003881258 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-05T07:54:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 13, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 13, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 0, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 11, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 12, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 10, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 10, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 1, 2024-09-05T07:54:59.872 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 1, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 50672, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223520 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 1, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 1, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 11, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.873 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.874 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.875 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-05T07:54:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000124716, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000124716 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-05T07:54:59.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.878 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.878 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.880 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-05T07:54:59.881 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.881 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.881 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.884 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.885 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-05T07:54:59.885 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.885 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.886 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.887 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.888 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-05T07:54:59.890 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.891 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.892 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 2, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1, 2024-09-05T07:54:59.893 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 209, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:54:59.894 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:54:59.895 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-05T07:54:59.896 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 238663, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 79, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-05T07:54:59.897 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7600, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 157, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 51240, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 200, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-05T07:54:59.898 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 43, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 12359, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 28, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 43, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 43, 2024-09-05T07:54:59.899 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.261996138, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006092933 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 43, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 65 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 43, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 43, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-05T07:54:59.900 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 6, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 8, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-05T07:54:59.901 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-05T07:54:59.902 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-05T07:54:59.903 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 85, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 9, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 9, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 14, 2024-09-05T07:54:59.904 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-05T07:54:59.905 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 305, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 775403, 2024-09-05T07:54:59.906 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 305, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 305, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 775403, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-05T07:54:59.907 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 43, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 12359, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 43, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 12359, 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:59.908 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:59.909 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 43, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 43, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 43, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 43, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:59.910 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55e14a0b0960": { 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 7, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1967, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 7, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:54:59.912 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 6, 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1967, 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:54:59.913 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-05T07:55:00.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:00 smithi175 ceph-mon[34585]: pgmap v462: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-05T07:55:00.678 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-05T07:55:00.678 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-05T07:55:00.678 DEBUG:tasks.check_counter:Getting stats from i 2024-09-05T07:55:00.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-05T07:55:00.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:00 smithi144 ceph-mon[29535]: pgmap v462: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-05T07:55:00.924 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:55:00.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:00 smithi154 ceph-mon[34710]: pgmap v462: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-05T07:55:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 43, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 48, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 11563, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 42871, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 13, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.011321844, 2024-09-05T07:55:01.428 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.001766928, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.007284160, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000626230, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 46, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.021689399, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000471508 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 32, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000008691, 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000271 2024-09-05T07:55:01.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 4784, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 5376 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 354, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 375, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 836973, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 183784, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.045216215, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.016138606, 2024-09-05T07:55:01.430 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.033257344, 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.002441325, 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 374, 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.031087490, 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000083121 2024-09-05T07:55:01.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.432 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:01.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 405, 2024-09-05T07:55:01.432 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000118074, 2024-09-05T07:55:01.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000291 2024-09-05T07:55:01.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 780032, 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 68112 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 17, 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 91, 2024-09-05T07:55:01.433 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6281, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 245039, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.010846118, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.003510852, 2024-09-05T07:55:01.434 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.005508396, 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000880603, 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 90, 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.017124964, 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000190277 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:01.435 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000148, 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000074 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 210096 2024-09-05T07:55:01.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-05T07:55:01.437 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 47, 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001529609, 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000032544 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000011598, 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000005799 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 3, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 2, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001083177, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000541588 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-05T07:55:01.440 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 14, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 14, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 14, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 2, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 2, 2024-09-05T07:55:01.441 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 2, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 3, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 1, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 1, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-05T07:55:01.442 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 5, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 10737418474, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:55:01.443 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 2, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 3, 2024-09-05T07:55:01.444 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 2, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 1 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 2, 2024-09-05T07:55:01.445 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-05T07:55:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 7, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-05T07:55:01.447 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 7, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-05T07:55:01.448 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4196271, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013389829, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002231638 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 17, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 17, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 0, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 15, 2024-09-05T07:55:01.449 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 16, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 14, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 14, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 2, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 2, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 50088, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223520 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.450 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 4, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 3, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 11, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-05T07:55:01.451 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000875972, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000875972 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000207205, 2024-09-05T07:55:01.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000207205 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-05T07:55:01.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-05T07:55:01.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-05T07:55:01.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-05T07:55:01.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-05T07:55:01.463 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 2, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 213, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-05T07:55:01.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:55:01.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:55:01.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 263287, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 91, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-05T07:55:01.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7600, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 157, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 68405, 2024-09-05T07:55:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 290, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 45, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 12824, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 45, 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-05T07:55:01.469 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 45, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.247996348, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005511029 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 45, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 69 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 45, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 45, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-05T07:55:01.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 6, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 8, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-05T07:55:01.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-05T07:55:01.472 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-05T07:55:01.473 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 85, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 10, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 10, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 18, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-05T07:55:01.474 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.475 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:01.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 410, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 806514, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 410, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 410, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 806514, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 45, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 12824, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 45, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 12824, 2024-09-05T07:55:01.478 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:01.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 45, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 45, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 45, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 45, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:01.480 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.481 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55c0d894a960": { 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 7, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1967, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 7, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:01.482 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 6, 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1967, 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-05T07:55:02.152 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-05T07:55:02.152 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-05T07:55:02.152 DEBUG:tasks.check_counter:Getting stats from l 2024-09-05T07:55:02.152 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-05T07:55:02.395 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T07:55:02.687 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:02 smithi154 ceph-mon[34710]: pgmap v463: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:55:02.771 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:02 smithi175 ceph-mon[34585]: pgmap v463: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:55:02.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:02 smithi144 ceph-mon[29535]: pgmap v463: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-05T07:55:02.873 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 458, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 451, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 866192, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 173682, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.061676744, 2024-09-05T07:55:02.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.019702082, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.031944724, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.013529658, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 450, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.025634334, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000056965 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.875 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 753632, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 67152 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 85, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1550, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 211550, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-09-05T07:55:02.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.005454191, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.003195968, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.001280816, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000095616, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 83, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005898999, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000071072 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.877 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 210528 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 342, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 342, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 92177, 2024-09-05T07:55:02.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 107933, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.032132519, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.011794496, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.009677035, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.007821397, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 341, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.016802705, 2024-09-05T07:55:02.879 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000049274 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-05T07:55:02.880 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-05T07:55:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-05T07:55:02.881 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1345, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.039614549, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000029453 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.882 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 0, 2024-09-05T07:55:02.884 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 1, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-05T07:55:02.885 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-09-05T07:55:02.886 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T07:55:02.887 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-05T07:55:02.888 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-05T07:55:02.889 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-05T07:55:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-05T07:55:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-05T07:55:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-05T07:55:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-05T07:55:02.890 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-05T07:55:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-05T07:55:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-05T07:55:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-05T07:55:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-05T07:55:02.891 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.892 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 2, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-05T07:55:02.893 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4194892, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 4194352, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.894 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 2 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 3, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 3, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 0, 2024-09-05T07:55:02.895 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 1, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 1, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 0, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 0, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 0, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-05T07:55:02.896 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 48168, 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215328 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-05T07:55:02.897 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.898 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.899 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-05T07:55:02.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.901 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-05T07:55:02.903 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.904 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-05T07:55:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.905 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-05T07:55:02.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.908 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-05T07:55:02.909 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.910 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.911 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-05T07:55:02.912 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.913 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-05T07:55:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.916 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.917 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-05T07:55:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 0, 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 0, 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 0, 2024-09-05T07:55:02.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 0, 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-05T07:55:02.924 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T07:55:02.925 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T07:55:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T07:55:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T07:55:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T07:55:02.926 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-05T07:55:02.927 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-05T07:55:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-05T07:55:02.929 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-05T07:55:02.929 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T07:55:02.929 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-05T07:55:02.930 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 189256, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 49, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-05T07:55:02.931 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7600, 2024-09-05T07:55:02.932 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 157, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 8512, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 13, 2024-09-05T07:55:02.933 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-05T07:55:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 676, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 676, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 676, 2024-09-05T07:55:02.935 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.315995293, 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000467448 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 676, 2024-09-05T07:55:02.936 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 677 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 676, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 676, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-05T07:55:02.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 335, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 339, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-05T07:55:02.938 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-09-05T07:55:02.939 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-05T07:55:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-05T07:55:02.941 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-05T07:55:02.942 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-05T07:55:02.943 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 85, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 5, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 5, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-05T07:55:02.944 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-05T07:55:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-09-05T07:55:02.948 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-05T07:55:02.948 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-05T07:55:02.948 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-05T07:55:02.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T07:55:02.949 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:55:02.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 800, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 878640, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 800, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 800, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 878640, 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:02.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:02.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 676, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 593, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 676, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 593, 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:02.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:02.954 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 676, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 676, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 676, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 676, 2024-09-05T07:55:02.955 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.956 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-05T07:55:02.957 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5641c90e6b40": { 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-05T07:55:02.958 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-05T07:55:02.959 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-05T07:55:02.960 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-05T07:55:02.960 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-05T07:55:02.960 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-05T07:55:02.960 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-05T07:55:02.961 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-05T07:55:02.961 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-05T07:55:02.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-05T07:55:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-05T07:55:03.648 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-05T07:55:03.648 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-05T07:55:03.648 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-05T07:55:04.565 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-05T07:55:04.566 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:55:04.566 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:55:04.609 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-05T07:55:04.609 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:55:04.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd blocklist ls 2024-09-05T07:55:04.781 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:04 smithi144 ceph-mon[29535]: pgmap v464: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-05T07:55:04.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:04 smithi175 ceph-mon[34585]: pgmap v464: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-05T07:55:04.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:04 smithi154 ceph-mon[34710]: pgmap v464: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-05T07:55:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:05.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 -- 172.21.15.144:0/1419951686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc106f10 msgr2=0x7f60fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:05.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 --2- 172.21.15.144:0/1419951686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc106f10 0x7f60fc10ea90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009ca0 tx=0x7f60f402a8c0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 -- 172.21.15.144:0/1419951686 shutdown_connections 2024-09-05T07:55:05.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 --2- 172.21.15.144:0/1419951686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc102790 0x7f60fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 --2- 172.21.15.144:0/1419951686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc106f10 0x7f60fc10ea90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 --2- 172.21.15.144:0/1419951686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc101de0 0x7f60fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 -- 172.21.15.144:0/1419951686 >> 172.21.15.144:0/1419951686 conn(0x7f60fc0fd8c0 msgr2=0x7f60fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 -- 172.21.15.144:0/1419951686 shutdown_connections 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.684+0000 7f6102800640 1 -- 172.21.15.144:0/1419951686 wait complete. 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.685+0000 7f6102800640 1 Processor -- start 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.685+0000 7f6102800640 1 -- start start 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 0x7f60fc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc106f10 0x7f60fc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc111f70 con 0x7f60fc102790 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc111df0 con 0x7f60fc101de0 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f6102800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1120f0 con 0x7f60fc106f10 2024-09-05T07:55:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47550/0 (socket says 172.21.15.144:47550) 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 -- 172.21.15.144:0/1910728107 learned_addr learned my addr 172.21.15.144:0/1910728107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60fb400640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 0x7f60fc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60fbe00640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc106f10 0x7f60fc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 -- 172.21.15.144:0/1910728107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc106f10 msgr2=0x7f60fc19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc106f10 0x7f60fc19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 -- 172.21.15.144:0/1910728107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 msgr2=0x7f60fc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 0x7f60fc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60f3e00640 1 -- 172.21.15.144:0/1910728107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc19f5b0 con 0x7f60fc102790 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.686+0000 7f60fb400640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 0x7f60fc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f60f3e00640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e9f0 tx=0x7f60e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e400cd80 con 0x7f60fc102790 2024-09-05T07:55:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e4010910 con 0x7f60fc102790 2024-09-05T07:55:05.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc19f8a0 con 0x7f60fc102790 2024-09-05T07:55:05.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4018990 con 0x7f60fc102790 2024-09-05T07:55:05.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.687+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc1a7180 con 0x7f60fc102790 2024-09-05T07:55:05.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.688+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60fc1021c0 con 0x7f60fc102790 2024-09-05T07:55:05.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.690+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f60e4010ac0 con 0x7f60fc102790 2024-09-05T07:55:05.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.691+0000 7f60f8c00640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 0x7f60e00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:05.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.692+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f60e40cf290 con 0x7f60fc102790 2024-09-05T07:55:05.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.692+0000 7f60fb400640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 0x7f60e00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:05.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.693+0000 7f60fb400640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 0x7f60e00a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009fc0 tx=0x7f60ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:05.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.696+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60e409bb30 con 0x7f60fc102790 2024-09-05T07:55:05.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.882+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60fc1a74b0 con 0x7f60fc102790 2024-09-05T07:55:05.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.882+0000 7f60f8c00640 1 -- 172.21.15.144:0/1910728107 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+597 (secure 0 0 0) 0x7f60e409fe30 con 0x7f60fc102790 2024-09-05T07:55:05.883 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6801/490246891 2024-09-06T07:42:05.153736+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6800/490246891 2024-09-06T07:42:05.153736+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/2725124016 2024-09-06T07:42:05.153736+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/618061674 2024-09-06T07:42:05.153736+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/1854894584 2024-09-06T07:41:38.279521+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/2641423854 2024-09-06T07:41:38.279521+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/952521696 2024-09-06T07:42:05.153736+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:0/855242424 2024-09-06T07:41:38.279521+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6801/3542536787 2024-09-06T07:41:38.279521+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6800/3542536787 2024-09-06T07:41:38.279521+0000 2024-09-05T07:55:05.884 INFO:teuthology.orchestra.run.smithi144.stderr:listed 10 entries 2024-09-05T07:55:05.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.884+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 msgr2=0x7f60e00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:05.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.884+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 0x7f60e00a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009fc0 tx=0x7f60ec005f90 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.884+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 msgr2=0x7f60fc19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.884+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e9f0 tx=0x7f60e400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 shutdown_connections 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f60e00a2c00 0x7f60e00a50c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60fc106f10 0x7f60fc19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc102790 0x7f60fc19abe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 --2- 172.21.15.144:0/1910728107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60fc101de0 0x7f60fc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 >> 172.21.15.144:0/1910728107 conn(0x7f60fc0fd8c0 msgr2=0x7f60fc0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 shutdown_connections 2024-09-05T07:55:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:05.885+0000 7f6102800640 1 -- 172.21.15.144:0/1910728107 wait complete. 2024-09-05T07:55:06.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:06 smithi144 ceph-mon[29535]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:55:06.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:06 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1910728107' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T07:55:06.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-05T07:55:06.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:55:06.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-05T07:55:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:06 smithi175 ceph-mon[34585]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:55:06.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:06 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1910728107' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T07:55:06.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:55:06.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:55:06.848 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-05T07:55:06.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:55:06.909 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-05T07:55:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:06 smithi154 ceph-mon[34710]: pgmap v465: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T07:55:06.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:06 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1910728107' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T07:55:06.944 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-05T07:55:06.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:55:06.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:55:07.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:55:07.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-05T07:55:07.391 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-05T07:55:07.401 INFO:tasks.cephadm:Teardown begin 2024-09-05T07:55:07.402 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-05T07:55:07.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:55:07.775 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:08.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 -- 172.21.15.144:0/3297645699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 msgr2=0x7ff838110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3297645699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff838110ca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 -- 172.21.15.144:0/3297645699 shutdown_connections 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3297645699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff838110ca0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3297645699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8381049a0 0x7ff8381089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3297645699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838103ff0 0x7ff8381043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 -- 172.21.15.144:0/3297645699 >> 172.21.15.144:0/3297645699 conn(0x7ff8380ffa90 msgr2=0x7ff838101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.337+0000 7ff83ec00640 1 -- 172.21.15.144:0/3297645699 shutdown_connections 2024-09-05T07:55:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.338+0000 7ff83ec00640 1 -- 172.21.15.144:0/3297645699 wait complete. 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.338+0000 7ff83ec00640 1 Processor -- start 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.338+0000 7ff83ec00640 1 -- start start 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 0x7ff83819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8381049a0 0x7ff83819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381141a0 con 0x7ff838109120 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff838114020 con 0x7ff8381049a0 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff838114320 con 0x7ff838103ff0 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47576/0 (socket says 172.21.15.144:47576) 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff83cc00640 1 -- 172.21.15.144:0/3840292205 learned_addr learned my addr 172.21.15.144:0/3840292205 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff837e00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 0x7ff83819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.339+0000 7ff837400640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8381049a0 0x7ff83819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 -- 172.21.15.144:0/3840292205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 msgr2=0x7ff83819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 0x7ff83819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 -- 172.21.15.144:0/3840292205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8381049a0 msgr2=0x7ff83819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8381049a0 0x7ff83819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 -- 172.21.15.144:0/3840292205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83819f590 con 0x7ff838109120 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff837e00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 0x7ff83819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83cc00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff830004770 tx=0x7ff830003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83003f070 con 0x7ff838109120 2024-09-05T07:55:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff830031c90 con 0x7ff838109120 2024-09-05T07:55:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83819f820 con 0x7ff838109120 2024-09-05T07:55:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830035030 con 0x7ff838109120 2024-09-05T07:55:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.340+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381a7160 con 0x7ff838109120 2024-09-05T07:55:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.342+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8381054d0 con 0x7ff838109120 2024-09-05T07:55:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.344+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff830042070 con 0x7ff838109120 2024-09-05T07:55:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.346+0000 7ff834c00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 0x7ff81c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.346+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7ff8300ef640 con 0x7ff838109120 2024-09-05T07:55:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.346+0000 7ff837e00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 0x7ff81c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.347+0000 7ff837e00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 0x7ff81c0a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:08.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.350+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8300bbfa0 con 0x7ff838109120 2024-09-05T07:55:08.571 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:08 smithi144 ceph-mon[29535]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:55:08.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.574+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8381a7330 con 0x7ff838109120 2024-09-05T07:55:08.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.575+0000 7ff834c00640 1 -- 172.21.15.144:0/3840292205 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11992 (secure 0 0 0) 0x7ff8300c02a0 con 0x7ff838109120 2024-09-05T07:55:08.576 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:55:08.576 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"btime":"2024-09-05T07:51:25:474887+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:51:25.127319+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24523,24521,24508,24502]},"id":1}]} 2024-09-05T07:55:08.577 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 29 2024-09-05T07:55:08.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.577+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 msgr2=0x7ff81c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.577+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 0x7ff81c0a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828009500 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 msgr2=0x7ff83819eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff830004770 tx=0x7ff830003b90 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 shutdown_connections 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7ff81c0a2b80 0x7ff81c0a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8381049a0 0x7ff83819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff838109120 0x7ff83819eeb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 --2- 172.21.15.144:0/3840292205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff838103ff0 0x7ff83819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 >> 172.21.15.144:0/3840292205 conn(0x7ff8380ffa90 msgr2=0x7ff8381005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 shutdown_connections 2024-09-05T07:55:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:08.578+0000 7ff83ec00640 1 -- 172.21.15.144:0/3840292205 wait complete. 2024-09-05T07:55:08.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:08 smithi175 ceph-mon[34585]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:55:08.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:08 smithi154 ceph-mon[34710]: pgmap v466: 97 pgs: 97 active+clean; 1.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T07:55:09.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:09 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/3840292205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:09.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:09 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/3840292205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:09.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:09 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/3840292205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:10.814 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:10 smithi144 ceph-mon[29535]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T07:55:10.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:10 smithi175 ceph-mon[34585]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T07:55:10.862 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T07:55:10.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:10 smithi154 ceph-mon[34710]: pgmap v467: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T07:55:11.235 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:11.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 -- 172.21.15.144:0/154040942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 msgr2=0x7fd870101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 --2- 172.21.15.144:0/154040942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd870101e40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009930 tx=0x7fd85c02a420 comp rx=0 tx=0).stop 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 -- 172.21.15.144:0/154040942 shutdown_connections 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 --2- 172.21.15.144:0/154040942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87010e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 --2- 172.21.15.144:0/154040942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd870101e40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 --2- 172.21.15.144:0/154040942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd870107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 -- 172.21.15.144:0/154040942 >> 172.21.15.144:0/154040942 conn(0x7fd8700fd700 msgr2=0x7fd8700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.812+0000 7fd86f200640 1 -- 172.21.15.144:0/154040942 shutdown_connections 2024-09-05T07:55:11.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.813+0000 7fd86f200640 1 -- 172.21.15.144:0/154040942 wait complete. 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 Processor -- start 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 -- start start 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd87019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd87019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd870111ef0 con 0x7fd8701019e0 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd870111d70 con 0x7fd870107af0 2024-09-05T07:55:11.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.814+0000 7fd86f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd870112070 con 0x7fd870102380 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd87019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd87019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47594/0 (socket says 172.21.15.144:47594) 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86de00640 1 -- 172.21.15.144:0/2217624586 learned_addr learned my addr 172.21.15.144:0/2217624586 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86e800640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd87019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 -- 172.21.15.144:0/2217624586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 msgr2=0x7fd87019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd87019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 -- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 msgr2=0x7fd87019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd87019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86d400640 1 -- 172.21.15.144:0/2217624586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87019f560 con 0x7fd870102380 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.815+0000 7fd86e800640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd87019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:55:11.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd86d400640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87019aaf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005940 tx=0x7fd85c031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c03f070 con 0x7fd870102380 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87019f7f0 con 0x7fd870102380 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd85c003ad0 con 0x7fd870102380 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c035070 con 0x7fd870102380 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.816+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a7130 con 0x7fd870102380 2024-09-05T07:55:11.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.817+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd870101e40 con 0x7fd870102380 2024-09-05T07:55:11.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.819+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd85c0035f0 con 0x7fd870102380 2024-09-05T07:55:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.820+0000 7fd866a00640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.820+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fd85c0ef880 con 0x7fd870102380 2024-09-05T07:55:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.821+0000 7fd86de00640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.821+0000 7fd86de00640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 0x7fd8540a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd860009c10 tx=0x7fd860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:11.823+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd85c0bc770 con 0x7fd870102380 2024-09-05T07:55:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.034+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd87019b910 con 0x7fd870102380 2024-09-05T07:55:12.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.035+0000 7fd866a00640 1 -- 172.21.15.144:0/2217624586 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11992 (secure 0 0 0) 0x7fd85c0bc070 con 0x7fd870102380 2024-09-05T07:55:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:55:12.037 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"btime":"2024-09-05T07:51:25:474887+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3359383404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3359383404},{"type":"v1","addr":"172.21.15.144:6835","nonce":3359383404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/1312798702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":1312798702},{"type":"v1","addr":"172.21.15.144:6839","nonce":1312798702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T07:49:15.848520+0000","modified":"2024-09-05T07:51:25.127319+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24533,"mds_1":24523,"mds_2":24521,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/292119763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":292119763},{"type":"v1","addr":"172.21.15.154:6833","nonce":292119763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3404092101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3404092101},{"type":"v1","addr":"172.21.15.175:6833","nonce":3404092101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2196844760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2196844760},{"type":"v1","addr":"172.21.15.144:6837","nonce":2196844760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/2155086348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2155086348},{"type":"v1","addr":"172.21.15.154:6835","nonce":2155086348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4186875626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4186875626},{"type":"v1","addr":"172.21.15.154:6837","nonce":4186875626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6835/1249902842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1249902842},{"type":"v1","addr":"172.21.15.175:6835","nonce":1249902842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6837/470737720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":470737720},{"type":"v1","addr":"172.21.15.175:6837","nonce":470737720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6841/1329376648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6840","nonce":1329376648},{"type":"v1","addr":"172.21.15.144:6841","nonce":1329376648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6839/571012615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":571012615},{"type":"v1","addr":"172.21.15.175:6839","nonce":571012615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/3557171279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3557171279},{"type":"v1","addr":"172.21.15.154:6839","nonce":3557171279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24533,"qdb_cluster":[24533,24523,24521,24508,24502]},"id":1}]} 2024-09-05T07:55:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 29 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 msgr2=0x7fd8540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 0x7fd8540a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd860009c10 tx=0x7fd860005f90 comp rx=0 tx=0).stop 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 msgr2=0x7fd87019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87019aaf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005940 tx=0x7fd85c031b50 comp rx=0 tx=0).stop 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 shutdown_connections 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd870107af0 0x7fd87019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870102380 0x7fd87019aaf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:12.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 --2- 172.21.15.144:0/2217624586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8701019e0 0x7fd87019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:12.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 >> 172.21.15.144:0/2217624586 conn(0x7fd8700fd700 msgr2=0x7fd87010d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:12.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.038+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 shutdown_connections 2024-09-05T07:55:12.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:12.039+0000 7fd86f200640 1 -- 172.21.15.144:0/2217624586 wait complete. 2024-09-05T07:55:12.715 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:12 smithi144 ceph-mon[29535]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:55:12.715 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:12 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2217624586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:12.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T07:55:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:12 smithi175 ceph-mon[34585]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:55:12.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:12 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2217624586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:12 smithi154 ceph-mon[34710]: pgmap v468: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-05T07:55:12.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:12 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2217624586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T07:55:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:13.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 -- 172.21.15.144:0/948089976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141019d0 msgr2=0x7f8e14101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 --2- 172.21.15.144:0/948089976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141019d0 0x7f8e14101e30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009930 tx=0x7f8e0002a420 comp rx=0 tx=0).stop 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 -- 172.21.15.144:0/948089976 shutdown_connections 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 --2- 172.21.15.144:0/948089976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 0x7f8e1410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 --2- 172.21.15.144:0/948089976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141019d0 0x7f8e14101e30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 --2- 172.21.15.144:0/948089976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141079d0 0x7f8e14107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 -- 172.21.15.144:0/948089976 >> 172.21.15.144:0/948089976 conn(0x7f8e140fd710 msgr2=0x7f8e140ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 -- 172.21.15.144:0/948089976 shutdown_connections 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.662+0000 7f8e13200640 1 -- 172.21.15.144:0/948089976 wait complete. 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 Processor -- start 2024-09-05T07:55:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 -- start start 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 0x7f8e1419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 0x7f8e1419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14111e20 con 0x7f8e141079d0 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14111ca0 con 0x7f8e141019d0 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.663+0000 7f8e13200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14111fa0 con 0x7f8e14102370 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e12800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:13.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 0x7f8e1419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e12800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56564/0 (socket says 172.21.15.144:56564) 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e12800640 1 -- 172.21.15.144:0/4262569121 learned_addr learned my addr 172.21.15.144:0/4262569121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11400640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 0x7f8e1419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 -- 172.21.15.144:0/4262569121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 msgr2=0x7f8e1419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 0x7f8e1419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 -- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 msgr2=0x7f8e1419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e11e00640 1 -- 172.21.15.144:0/4262569121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1419f4d0 con 0x7f8e141019d0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.664+0000 7f8e12800640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e11e00640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 0x7f8e1419a520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400e9f0 tx=0x7f8e0400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400ccc0 con 0x7f8e141019d0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1419f7c0 con 0x7f8e141019d0 2024-09-05T07:55:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e04010910 con 0x7f8e141019d0 2024-09-05T07:55:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04018960 con 0x7f8e141019d0 2024-09-05T07:55:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.665+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141a70a0 con 0x7f8e141019d0 2024-09-05T07:55:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.666+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e14101e30 con 0x7f8e141019d0 2024-09-05T07:55:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.668+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8e04010ac0 con 0x7f8e141019d0 2024-09-05T07:55:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.669+0000 7f8e0aa00640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 0x7f8df80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.669+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7f8e040cf6d0 con 0x7f8e141019d0 2024-09-05T07:55:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.670+0000 7f8e11400640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 0x7f8df80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.670+0000 7f8e11400640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 0x7f8df80a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e00006010 tx=0x7f8e00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:13.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.671+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e0409bf70 con 0x7f8e141019d0 2024-09-05T07:55:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.848+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e141a72a0 con 0x7f8e141019d0 2024-09-05T07:55:13.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.850+0000 7f8e0aa00640 1 -- 172.21.15.144:0/4262569121 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22868 (secure 0 0 0) 0x7f8e040a0270 con 0x7f8e141019d0 2024-09-05T07:55:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-05T07:55:13.851 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":85,"fsid":"17138d32-6b5a-11ef-bcd6-c7b262605968","created":"2024-09-05T07:41:13.589749+0000","modified":"2024-09-05T07:50:06.457858+0000","last_up_change":"2024-09-05T07:48:17.448903+0000","last_in_change":"2024-09-05T07:47:54.513792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:44:23.743416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:49:11.242427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:49:13.920843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c52fde6-9ed3-449b-8766-8d9e061d3cd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6803","nonce":1617602534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6805","nonce":1617602534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6809","nonce":1617602534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1617602534},{"type":"v1","addr":"172.21.15.144:6807","nonce":1617602534}]},"public_addr":"172.21.15.144:6803/1617602534","cluster_addr":"172.21.15.144:6805/1617602534","heartbeat_back_addr":"172.21.15.144:6809/1617602534","heartbeat_front_addr":"172.21.15.144:6807/1617602534","state":["exists","up"]},{"osd":1,"uuid":"8b29546a-9c89-436e-8088-5a87b65a9b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6801","nonce":3510298386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6803","nonce":3510298386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6807","nonce":3510298386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3510298386},{"type":"v1","addr":"172.21.15.154:6805","nonce":3510298386}]},"public_addr":"172.21.15.154:6801/3510298386","cluster_addr":"172.21.15.154:6803/3510298386","heartbeat_back_addr":"172.21.15.154:6807/3510298386","heartbeat_front_addr":"172.21.15.154:6805/3510298386","state":["exists","up"]},{"osd":2,"uuid":"5835e07e-341b-4071-acc0-6d1de7f931a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6801","nonce":1799064874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6803","nonce":1799064874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6807","nonce":1799064874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1799064874},{"type":"v1","addr":"172.21.15.175:6805","nonce":1799064874}]},"public_addr":"172.21.15.175:6801/1799064874","cluster_addr":"172.21.15.175:6803/1799064874","heartbeat_back_addr":"172.21.15.175:6807/1799064874","heartbeat_front_addr":"172.21.15.175:6805/1799064874","state":["exists","up"]},{"osd":3,"uuid":"5dc8b828-3d7f-4248-b39e-5c5edc7650e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6811","nonce":827690794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6813","nonce":827690794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6817","nonce":827690794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":827690794},{"type":"v1","addr":"172.21.15.144:6815","nonce":827690794}]},"public_addr":"172.21.15.144:6811/827690794","cluster_addr":"172.21.15.144:6813/827690794","heartbeat_back_addr":"172.21.15.144:6817/827690794","heartbeat_front_addr":"172.21.15.144:6815/827690794","state":["exists","up"]},{"osd":4,"uuid":"b5e2a66d-cac2-4cd1-8559-df0856070bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6809","nonce":4185525506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6811","nonce":4185525506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6815","nonce":4185525506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4185525506},{"type":"v1","addr":"172.21.15.154:6813","nonce":4185525506}]},"public_addr":"172.21.15.154:6809/4185525506","cluster_addr":"172.21.15.154:6811/4185525506","heartbeat_back_addr":"172.21.15.154:6815/4185525506","heartbeat_front_addr":"172.21.15.154:6813/4185525506","state":["exists","up"]},{"osd":5,"uuid":"aeee00a8-ae82-475e-8fc3-c027522f80a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6809","nonce":3675433893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6811","nonce":3675433893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6815","nonce":3675433893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3675433893},{"type":"v1","addr":"172.21.15.175:6813","nonce":3675433893}]},"public_addr":"172.21.15.175:6809/3675433893","cluster_addr":"172.21.15.175:6811/3675433893","heartbeat_back_addr":"172.21.15.175:6815/3675433893","heartbeat_front_addr":"172.21.15.175:6813/3675433893","state":["exists","up"]},{"osd":6,"uuid":"f7d7f17d-6323-408a-b7bb-7959f4778f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6819","nonce":2321298943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6821","nonce":2321298943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6825","nonce":2321298943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2321298943},{"type":"v1","addr":"172.21.15.144:6823","nonce":2321298943}]},"public_addr":"172.21.15.144:6819/2321298943","cluster_addr":"172.21.15.144:6821/2321298943","heartbeat_back_addr":"172.21.15.144:6825/2321298943","heartbeat_front_addr":"172.21.15.144:6823/2321298943","state":["exists","up"]},{"osd":7,"uuid":"4bcfdc2c-3009-44d2-8fc6-696c92a9b9b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6817","nonce":1490453395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6819","nonce":1490453395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6823","nonce":1490453395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1490453395},{"type":"v1","addr":"172.21.15.154:6821","nonce":1490453395}]},"public_addr":"172.21.15.154:6817/1490453395","cluster_addr":"172.21.15.154:6819/1490453395","heartbeat_back_addr":"172.21.15.154:6823/1490453395","heartbeat_front_addr":"172.21.15.154:6821/1490453395","state":["exists","up"]},{"osd":8,"uuid":"cf5ed3c6-80ad-4e8f-a862-c844a1bc749f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6817","nonce":1421352670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6819","nonce":1421352670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6823","nonce":1421352670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1421352670},{"type":"v1","addr":"172.21.15.175:6821","nonce":1421352670}]},"public_addr":"172.21.15.175:6817/1421352670","cluster_addr":"172.21.15.175:6819/1421352670","heartbeat_back_addr":"172.21.15.175:6823/1421352670","heartbeat_front_addr":"172.21.15.175:6821/1421352670","state":["exists","up"]},{"osd":9,"uuid":"0975ea21-df34-40c4-96a3-80758343a594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6827","nonce":2500230647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6829","nonce":2500230647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6833","nonce":2500230647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2500230647},{"type":"v1","addr":"172.21.15.144:6831","nonce":2500230647}]},"public_addr":"172.21.15.144:6827/2500230647","cluster_addr":"172.21.15.144:6829/2500230647","heartbeat_back_addr":"172.21.15.144:6833/2500230647","heartbeat_front_addr":"172.21.15.144:6831/2500230647","state":["exists","up"]},{"osd":10,"uuid":"cbdcbe9a-a9f5-4ba6-a198-493d6b15d654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6825","nonce":1235754603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6827","nonce":1235754603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6831","nonce":1235754603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1235754603},{"type":"v1","addr":"172.21.15.154:6829","nonce":1235754603}]},"public_addr":"172.21.15.154:6825/1235754603","cluster_addr":"172.21.15.154:6827/1235754603","heartbeat_back_addr":"172.21.15.154:6831/1235754603","heartbeat_front_addr":"172.21.15.154:6829/1235754603","state":["exists","up"]},{"osd":11,"uuid":"39af7621-a97a-4c97-8a70-be9bc9772b10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6825","nonce":3823820862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6827","nonce":3823820862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6831","nonce":3823820862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3823820862},{"type":"v1","addr":"172.21.15.175:6829","nonce":3823820862}]},"public_addr":"172.21.15.175:6825/3823820862","cluster_addr":"172.21.15.175:6827/3823820862","heartbeat_back_addr":"172.21.15.175:6831/3823820862","heartbeat_front_addr":"172.21.15.175:6829/3823820862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:31.947935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:43:57.005550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:20.257399+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:44:47.714197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:13.416890+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:45:37.087091+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:05.670933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:31.549506+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:46:56.265275+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:25.366016+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:47:49.698983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:48:15.461786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6801/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:6800/490246891":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/2725124016":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/618061674":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/1854894584":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/2641423854":"2024-09-06T07:41:38.279521+0000","172.21.15.144:0/952521696":"2024-09-06T07:42:05.153736+0000","172.21.15.144:0/855242424":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6801/3542536787":"2024-09-06T07:41:38.279521+0000","172.21.15.144:6800/3542536787":"2024-09-06T07:41:38.279521+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 msgr2=0x7f8df80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 0x7f8df80a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e00006010 tx=0x7f8e00000bc0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 msgr2=0x7f8e1419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 0x7f8e1419a520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400e9f0 tx=0x7f8e0400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 shutdown_connections 2024-09-05T07:55:13.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f8df80a2c00 0x7f8df80a50c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e141079d0 0x7f8e1419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e14102370 0x7f8e1419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 --2- 172.21.15.144:0/4262569121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e141019d0 0x7f8e1419a520 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 >> 172.21.15.144:0/4262569121 conn(0x7f8e140fd710 msgr2=0x7f8e140fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 shutdown_connections 2024-09-05T07:55:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:13.852+0000 7f8e13200640 1 -- 172.21.15.144:0/4262569121 wait complete. 2024-09-05T07:55:14.649 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs fail cephfs 2024-09-05T07:55:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:14 smithi144 ceph-mon[29535]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:55:14.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:14 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/4262569121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:55:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:14 smithi175 ceph-mon[34585]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:55:14.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:14 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/4262569121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:55:14.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:14 smithi154 ceph-mon[34710]: pgmap v469: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-05T07:55:14.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:14 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/4262569121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T07:55:15.023 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:15.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 -- 172.21.15.144:0/3684538234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 msgr2=0x7fb9fc114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 --2- 172.21.15.144:0/3684538234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc114e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009ca0 tx=0x7fb9f402a8c0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 -- 172.21.15.144:0/3684538234 shutdown_connections 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 --2- 172.21.15.144:0/3684538234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 --2- 172.21.15.144:0/3684538234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc114e20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 --2- 172.21.15.144:0/3684538234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 -- 172.21.15.144:0/3684538234 >> 172.21.15.144:0/3684538234 conn(0x7fb9fc0ffa90 msgr2=0x7fb9fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 -- 172.21.15.144:0/3684538234 shutdown_connections 2024-09-05T07:55:15.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.603+0000 7fba01800640 1 -- 172.21.15.144:0/3684538234 wait complete. 2024-09-05T07:55:15.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.604+0000 7fba01800640 1 Processor -- start 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.604+0000 7fba01800640 1 -- start start 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc1185d0 con 0x7fb9fc112a30 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc118450 con 0x7fb9fc077040 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fba01800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc118750 con 0x7fb9fc076720 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fb9faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fb9fa000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fb9fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fb9fa000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:59880/0 (socket says 172.21.15.144:59880) 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.605+0000 7fb9fa000640 1 -- 172.21.15.144:0/2426291856 learned_addr learned my addr 172.21.15.144:0/2426291856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 -- 172.21.15.144:0/2426291856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 msgr2=0x7fb9fc1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:15.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 -- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 msgr2=0x7fb9fc19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:15.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 -- 172.21.15.144:0/2426291856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc19efa0 con 0x7fb9fc076720 2024-09-05T07:55:15.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9faa00640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc1a46b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e9f0 tx=0x7fb9ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ccc0 con 0x7fb9fc076720 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc19f290 con 0x7fb9fc076720 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9ec005020 con 0x7fb9fc076720 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0049e0 con 0x7fb9fc076720 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.606+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc1ab580 con 0x7fb9fc076720 2024-09-05T07:55:15.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.608+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc076b00 con 0x7fb9fc076720 2024-09-05T07:55:15.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.610+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb9ec005560 con 0x7fb9fc076720 2024-09-05T07:55:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.611+0000 7fb9f3400640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 0x7fb9e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.611+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8248+0+0 (secure 0 0 0) 0x7fb9ec0cefe0 con 0x7fb9fc076720 2024-09-05T07:55:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.611+0000 7fb9fa000640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 0x7fb9e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.612+0000 7fb9fa000640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 0x7fb9e00a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0792b0 tx=0x7fb9e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:15.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.613+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9ec0051d0 con 0x7fb9fc076720 2024-09-05T07:55:15.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.831+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb9fc19fda0 con 0x7fb9fc076720 2024-09-05T07:55:15.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.841+0000 7fb9f3400640 1 -- 172.21.15.144:0/2426291856 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fb9fc19fda0 con 0x7fb9fc076720 2024-09-05T07:55:15.842 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.843+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 msgr2=0x7fb9e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.843+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 0x7fb9e00a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0792b0 tx=0x7fb9e8005f90 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.843+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 msgr2=0x7fb9fc1a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.843+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc1a46b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e9f0 tx=0x7fb9ec00eeb0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 shutdown_connections 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fb9e00a2b80 0x7fb9e00a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9fc077040 0x7fb9fc1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc112a30 0x7fb9fc19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 --2- 172.21.15.144:0/2426291856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9fc076720 0x7fb9fc1a46b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 >> 172.21.15.144:0/2426291856 conn(0x7fb9fc0ffa90 msgr2=0x7fb9fc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:15.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 shutdown_connections 2024-09-05T07:55:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:15.844+0000 7fba01800640 1 -- 172.21.15.144:0/2426291856 wait complete. 2024-09-05T07:55:16.187 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.187 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.187 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-mds[63483]: -- 172.21.15.154:0/2832161177 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564653fb9860 con 0x564653f96800 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: starting mds.e at 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-mds[63796]: -- 172.21.15.154:0/1882983511 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558951f9b860 con 0x558951f79000 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: starting mds.h at 2024-09-05T07:55:16.188 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-mds[64093]: -- 172.21.15.154:0/1778802604 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570c8335860 con 0x5570c8312800 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: starting mds.b at 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.189 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:55:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: starting mds.k at 2024-09-05T07:55:16.207 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a[29531]: 2024-09-05T07:55:15.832+0000 7f2851c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T07:55:16.207 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-mds[69358]: -- 172.21.15.144:0/4063328966 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8c659dc20 con 0x55d8c657a800 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: starting mds.d at 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-mds[70564]: -- 172.21.15.144:0/2113949808 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d29afa1c20 con 0x55d29af7f400 2024-09-05T07:55:16.208 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:55:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: starting mds.a at 2024-09-05T07:55:16.337 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.337 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.337 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-mds[64485]: -- 172.21.15.175:0/2914689917 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcd09f9860 con 0x55bcd09d7000 2024-09-05T07:55:16.338 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: starting mds.f at 2024-09-05T07:55:16.338 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.338 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.338 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-mds[64184]: -- 172.21.15.175:0/3057466493 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba0f9a9860 con 0x55ba0f987000 2024-09-05T07:55:16.338 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: starting mds.l at 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c[64797]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c[64797]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-mds[64801]: -- 172.21.15.175:0/3238279112 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f0efa1860 con 0x563f0ef7f000 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c[64797]: starting mds.c at 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: ignoring --setuser ceph since I am not root 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: ignoring --setgroup ceph since I am not root 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-mds[65103]: -- 172.21.15.175:0/964345297 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564aa1e63860 con 0x564aa1e41000 2024-09-05T07:55:16.339 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:55:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: starting mds.i at 2024-09-05T07:55:16.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: pgmap v470: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2426291856' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T07:55:16.782 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:16 smithi144 ceph-mon[29535]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: pgmap v470: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2426291856' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T07:55:16.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:16 smithi175 ceph-mon[34585]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T07:55:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: pgmap v470: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-05T07:55:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2426291856' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T07:55:16.937 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T07:55:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T07:55:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T07:55:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T07:55:16.938 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:16 smithi154 ceph-mon[34710]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T07:55:17.127 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:17.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 -- 172.21.15.144:0/1744220427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05141049c0 msgr2=0x7f0514108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 --2- 172.21.15.144:0/1744220427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05141049c0 0x7f0514108a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0500009900 tx=0x7f050002a3f0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 -- 172.21.15.144:0/1744220427 shutdown_connections 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 --2- 172.21.15.144:0/1744220427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514109140 0x7f0514110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 --2- 172.21.15.144:0/1744220427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05141049c0 0x7f0514108a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 --2- 172.21.15.144:0/1744220427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514104010 0x7f05141043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 -- 172.21.15.144:0/1744220427 >> 172.21.15.144:0/1744220427 conn(0x7f05140ffa50 msgr2=0x7f0514101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 -- 172.21.15.144:0/1744220427 shutdown_connections 2024-09-05T07:55:17.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.735+0000 7f051c400640 1 -- 172.21.15.144:0/1744220427 wait complete. 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.736+0000 7f051c400640 1 Processor -- start 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 -- start start 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514104010 0x7f051419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 0x7f051419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0514114140 con 0x7f0514109140 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0514113fc0 con 0x7f0514104010 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05141142c0 con 0x7f05141049c0 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f0519000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f0519000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36022/0 (socket says 172.21.15.144:36022) 2024-09-05T07:55:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f0519000640 1 -- 172.21.15.144:0/2601209982 learned_addr learned my addr 172.21.15.144:0/2601209982 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f0519a00640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514104010 0x7f051419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.737+0000 7f051a400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 0x7f051419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 -- 172.21.15.144:0/2601209982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514104010 msgr2=0x7f051419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514104010 0x7f051419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 -- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 msgr2=0x7f051419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 0x7f051419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 -- 172.21.15.144:0/2601209982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051419f660 con 0x7f05141049c0 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f051a400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 0x7f051419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T07:55:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0519000640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0500006010 tx=0x7f0500004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.738+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050003f030 con 0x7f05141049c0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.739+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051419f8f0 con 0x7f05141049c0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.739+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0500004440 con 0x7f05141049c0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.739+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500035070 con 0x7f05141049c0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.739+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05141a7230 con 0x7f05141049c0 2024-09-05T07:55:17.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.740+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05141054f0 con 0x7f05141049c0 2024-09-05T07:55:17.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.742+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0500042030 con 0x7f05141049c0 2024-09-05T07:55:17.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.743+0000 7f0512000640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 0x7f04fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:17.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.744+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8678+0+0 (secure 0 0 0) 0x7f05000ef8c0 con 0x7f05141049c0 2024-09-05T07:55:17.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.744+0000 7f0519a00640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 0x7f04fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:17.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.744+0000 7f0519a00640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 0x7f04fc0a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0508009bd0 tx=0x7f0508005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:17.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.745+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05000bc600 con 0x7f05141049c0 2024-09-05T07:55:17.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:17.956+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f051410c380 con 0x7f05141049c0 2024-09-05T07:55:17.957 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6832/433215273,v1:172.21.15.175:6833/433215273] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6832/3506686707,v1:172.21.15.154:6833/3506686707] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6834/691895634,v1:172.21.15.175:6835/691895634] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6836/148011872,v1:172.21.15.175:6837/148011872] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6834/2063810541,v1:172.21.15.154:6835/2063810541] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6836/699393592,v1:172.21.15.154:6837/699393592] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.175:6838/1067604533,v1:172.21.15.175:6839/1067604533] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.154:6838/2951100418,v1:172.21.15.154:6839/2951100418] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6836/1049542635,v1:172.21.15.144:6841/1049542635] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: mds.? [v2:172.21.15.144:6837/536020419,v1:172.21.15.144:6840/536020419] up:boot 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:55:17.958 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:55:17.959 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:17 smithi144 ceph-mon[29535]: pgmap v472: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-05T07:55:18.087 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6832/433215273,v1:172.21.15.175:6833/433215273] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6832/3506686707,v1:172.21.15.154:6833/3506686707] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6834/691895634,v1:172.21.15.175:6835/691895634] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6836/148011872,v1:172.21.15.175:6837/148011872] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6834/2063810541,v1:172.21.15.154:6835/2063810541] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6836/699393592,v1:172.21.15.154:6837/699393592] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.175:6838/1067604533,v1:172.21.15.175:6839/1067604533] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.154:6838/2951100418,v1:172.21.15.154:6839/2951100418] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6836/1049542635,v1:172.21.15.144:6841/1049542635] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: mds.? [v2:172.21.15.144:6837/536020419,v1:172.21.15.144:6840/536020419] up:boot 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T07:55:18.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:55:18.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:17 smithi175 ceph-mon[34585]: pgmap v472: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-05T07:55:18.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6832/433215273,v1:172.21.15.175:6833/433215273] up:boot 2024-09-05T07:55:18.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6832/3506686707,v1:172.21.15.154:6833/3506686707] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6834/691895634,v1:172.21.15.175:6835/691895634] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6836/148011872,v1:172.21.15.175:6837/148011872] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6834/2063810541,v1:172.21.15.154:6835/2063810541] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6836/699393592,v1:172.21.15.154:6837/699393592] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.175:6838/1067604533,v1:172.21.15.175:6839/1067604533] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.154:6838/2951100418,v1:172.21.15.154:6839/2951100418] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6836/1049542635,v1:172.21.15.144:6841/1049542635] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: mds.? [v2:172.21.15.144:6837/536020419,v1:172.21.15.144:6840/536020419] up:boot 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T07:55:18.188 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: from='mgr.14150 172.21.15.144:0/592607913' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T07:55:18.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:17 smithi154 ceph-mon[34710]: pgmap v472: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-05T07:55:18.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.850+0000 7f0512000640 1 -- 172.21.15.144:0/2601209982 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f05000bbf00 con 0x7f05141049c0 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 msgr2=0x7f04fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 0x7f04fc0a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0508009bd0 tx=0x7f0508005f90 comp rx=0 tx=0).stop 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 msgr2=0x7f051419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0500006010 tx=0x7f0500004040 comp rx=0 tx=0).stop 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 shutdown_connections 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f04fc0a2b80 0x7f04fc0a5040 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0514109140 0x7f051419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:18.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141049c0 0x7f051419abf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:18.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 --2- 172.21.15.144:0/2601209982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0514104010 0x7f051419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:18.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 >> 172.21.15.144:0/2601209982 conn(0x7f05140ffa50 msgr2=0x7f0514100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:18.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 shutdown_connections 2024-09-05T07:55:18.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:18.853+0000 7f051c400640 1 -- 172.21.15.144:0/2601209982 wait complete. 2024-09-05T07:55:19.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:18 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2601209982' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:18 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.203 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:18 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2601209982' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.203 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:18 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:18 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2601209982' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:18 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T07:55:19.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-05T07:55:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T07:55:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T07:55:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: Cluster is now healthy 2024-09-05T07:55:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:55:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: fsmap 12 up:standby 2024-09-05T07:55:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:19 smithi175 ceph-mon[34585]: pgmap v473: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T07:55:20.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T07:55:20.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T07:55:20.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: Cluster is now healthy 2024-09-05T07:55:20.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:55:20.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: fsmap 12 up:standby 2024-09-05T07:55:20.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:19 smithi144 ceph-mon[29535]: pgmap v473: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T07:55:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: Cluster is now healthy 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: fsmap 12 up:standby 2024-09-05T07:55:20.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:19 smithi154 ceph-mon[34710]: pgmap v473: 97 pgs: 97 active+clean; 1.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 -- 172.21.15.144:0/446220678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 msgr2=0x7f341c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 --2- 172.21.15.144:0/446220678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c103120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f340c009900 tx=0x7f340c02a480 comp rx=0 tx=0).stop 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 -- 172.21.15.144:0/446220678 shutdown_connections 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 --2- 172.21.15.144:0/446220678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 --2- 172.21.15.144:0/446220678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 --2- 172.21.15.144:0/446220678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c103120 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 -- 172.21.15.144:0/446220678 >> 172.21.15.144:0/446220678 conn(0x7f341c0fc7a0 msgr2=0x7f341c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 -- 172.21.15.144:0/446220678 shutdown_connections 2024-09-05T07:55:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.698+0000 7f3421a00640 1 -- 172.21.15.144:0/446220678 wait complete. 2024-09-05T07:55:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.699+0000 7f3421a00640 1 Processor -- start 2024-09-05T07:55:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 -- start start 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c1a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f341c100d80 con 0x7f341c102d40 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f341c100c00 con 0x7f341c103660 2024-09-05T07:55:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3421a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f341c100f00 con 0x7f341c10c170 2024-09-05T07:55:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f341aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c1a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f341b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.700+0000 7f3413e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f341aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c1a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56644/0 (socket says 172.21.15.144:56644) 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f341aa00640 1 -- 172.21.15.144:0/1415332463 learned_addr learned my addr 172.21.15.144:0/1415332463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f341b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.144:36044/0 (socket says 172.21.15.144:36044) 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 -- 172.21.15.144:0/1415332463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 msgr2=0x7f341c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 -- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 msgr2=0x7f341c1a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c1a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 -- 172.21.15.144:0/1415332463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c19f5d0 con 0x7f341c103660 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413e00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c1a06f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f340400e9f0 tx=0x7f340400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.701+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340400ccc0 con 0x7f341c103660 2024-09-05T07:55:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.702+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c19f8c0 con 0x7f341c103660 2024-09-05T07:55:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.702+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34040035f0 con 0x7f341c103660 2024-09-05T07:55:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.702+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340400ce60 con 0x7f341c103660 2024-09-05T07:55:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.702+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1a71a0 con 0x7f341c103660 2024-09-05T07:55:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.703+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c103120 con 0x7f341c103660 2024-09-05T07:55:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.705+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f34040037a0 con 0x7f341c103660 2024-09-05T07:55:20.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.706+0000 7f3413400640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 0x7f34000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:20.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.706+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8678+0+0 (secure 0 0 0) 0x7f34040cf4f0 con 0x7f341c103660 2024-09-05T07:55:20.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.706+0000 7f341aa00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 0x7f34000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:20.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.707+0000 7f341aa00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 0x7f34000a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f340c0096c0 tx=0x7f340c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.710+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f340409c230 con 0x7f341c103660 2024-09-05T07:55:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.886+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f341c1a74a0 con 0x7f341c103660 2024-09-05T07:55:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.943+0000 7f3413400640 1 -- 172.21.15.144:0/1415332463 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f340409bb30 con 0x7f341c103660 2024-09-05T07:55:20.945 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-05T07:55:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 msgr2=0x7f34000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 0x7f34000a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f340c0096c0 tx=0x7f340c005a20 comp rx=0 tx=0).stop 2024-09-05T07:55:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 msgr2=0x7f341c1a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c1a06f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f340400e9f0 tx=0x7f340400eeb0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 shutdown_connections 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7f34000a2b80 0x7f34000a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c103660 0x7f341c1a06f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f341c10c170 0x7f341c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 --2- 172.21.15.144:0/1415332463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f341c102d40 0x7f341c1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.946+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 >> 172.21.15.144:0/1415332463 conn(0x7f341c0fc7a0 msgr2=0x7f341c10c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.947+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 shutdown_connections 2024-09-05T07:55:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:20.947+0000 7f3421a00640 1 -- 172.21.15.144:0/1415332463 wait complete. 2024-09-05T07:55:21.321 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:20 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/1415332463' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:20 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:20 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/1415332463' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:20 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:20 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/1415332463' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:20 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:21.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-05T07:55:22.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:21 smithi144 ceph-mon[29535]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:22.071 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:21 smithi144 ceph-mon[29535]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T07:55:22.072 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:21 smithi144 ceph-mon[29535]: pgmap v475: 65 pgs: 65 active+clean; 577 KiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:22.186 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T07:55:22.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:21 smithi175 ceph-mon[34585]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:22.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:21 smithi175 ceph-mon[34585]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T07:55:22.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:21 smithi175 ceph-mon[34585]: pgmap v475: 65 pgs: 65 active+clean; 577 KiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:22.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:21 smithi154 ceph-mon[34710]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:22.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:21 smithi154 ceph-mon[34710]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T07:55:22.338 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:21 smithi154 ceph-mon[34710]: pgmap v475: 65 pgs: 65 active+clean; 577 KiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:22.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 -- 172.21.15.144:0/281127054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074590 msgr2=0x7fd04c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:22.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 --2- 172.21.15.144:0/281127054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074590 0x7fd04c074970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009be0 tx=0x7fd03c02a750 comp rx=0 tx=0).stop 2024-09-05T07:55:22.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 -- 172.21.15.144:0/281127054 shutdown_connections 2024-09-05T07:55:22.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 --2- 172.21.15.144:0/281127054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1129e0 0x7fd04c114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 --2- 172.21.15.144:0/281127054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c074eb0 0x7fd04c1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 --2- 172.21.15.144:0/281127054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074590 0x7fd04c074970 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 -- 172.21.15.144:0/281127054 >> 172.21.15.144:0/281127054 conn(0x7fd04c0fd710 msgr2=0x7fd04c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 -- 172.21.15.144:0/281127054 shutdown_connections 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.738+0000 7fd050e00640 1 -- 172.21.15.144:0/281127054 wait complete. 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 Processor -- start 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 -- start start 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c074590 0x7fd04c1a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c1183a0 con 0x7fd04c1129e0 2024-09-05T07:55:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c118220 con 0x7fd04c074eb0 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.739+0000 7fd050e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c118520 con 0x7fd04c074590 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd042a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd042a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.144:59976/0 (socket says 172.21.15.144:59976) 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56674/0 (socket says 172.21.15.144:56674) 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd042a00640 1 -- 172.21.15.144:0/2419132986 learned_addr learned my addr 172.21.15.144:0/2419132986 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04b400640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c074590 0x7fd04c1a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 -- 172.21.15.144:0/2419132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c074590 msgr2=0x7fd04c1a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c074590 0x7fd04c1a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 -- 172.21.15.144:0/2419132986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 msgr2=0x7fd04c1a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 -- 172.21.15.144:0/2419132986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c19ef30 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd042a00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.740+0000 7fd04be00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd04400e940 tx=0x7fd04400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.741+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400ccc0 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.741+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c19f220 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.741+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd044005020 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.741+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044004a00 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.741+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1ab570 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.742+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c075cd0 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.744+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd0440051d0 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.745+0000 7fd048c00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 0x7fd0300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.745+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8145+0+0 (secure 0 0 0) 0x7fd0440cef30 con 0x7fd04c1129e0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.745+0000 7fd04b400640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 0x7fd0300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:55:22.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.746+0000 7fd04b400640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 0x7fd0300a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000f80 tx=0x7fd03c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:55:22.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.749+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd04409be90 con 0x7fd04c1129e0 2024-09-05T07:55:22.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.922+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd04c104e20 con 0x7fd04c1129e0 2024-09-05T07:55:22.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.959+0000 7fd048c00640 1 -- 172.21.15.144:0/2419132986 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7fd04409b790 con 0x7fd04c1129e0 2024-09-05T07:55:22.960 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-05T07:55:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.962+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 msgr2=0x7fd0300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.962+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 0x7fd0300a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000f80 tx=0x7fd03c005fd0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.962+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 msgr2=0x7fd04c19e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:55:22.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.962+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd04400e940 tx=0x7fd04400ee00 comp rx=0 tx=0).stop 2024-09-05T07:55:22.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 shutdown_connections 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:6800/2361768482,v1:172.21.15.144:6801/2361768482] conn(0x7fd0300a2b80 0x7fd0300a5040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04c074eb0 0x7fd04c1a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04c1129e0 0x7fd04c19e6c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 --2- 172.21.15.144:0/2419132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c074590 0x7fd04c1a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 >> 172.21.15.144:0/2419132986 conn(0x7fd04c0fd710 msgr2=0x7fd04c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 shutdown_connections 2024-09-05T07:55:22.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-05T07:55:22.965+0000 7fd050e00640 1 -- 172.21.15.144:0/2419132986 wait complete. 2024-09-05T07:55:23.319 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:22 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:23.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:22 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:23.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:22 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T07:55:23.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:55:23.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:55:23.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:55:23.873 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-05T07:55:23.873 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T07:55:23.908 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T07:55:23.924 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T07:55:23.941 INFO:tasks.cephadm:Stopping all daemons... 2024-09-05T07:55:23.942 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-05T07:55:23.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a 2024-09-05T07:55:24.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:23 smithi154 ceph-mon[34710]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:24.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:23 smithi154 ceph-mon[34710]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T07:55:24.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:23 smithi154 ceph-mon[34710]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:24.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:23 smithi144 ceph-mon[29535]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:24.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:23 smithi144 ceph-mon[29535]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T07:55:24.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:23 smithi144 ceph-mon[29535]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:24.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:24 smithi144 systemd[1]: Stopping Ceph mon.a for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:24.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:23 smithi175 ceph-mon[34585]: from='client.? 172.21.15.144:0/2419132986' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T07:55:24.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:23 smithi175 ceph-mon[34585]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T07:55:24.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:23 smithi175 ceph-mon[34585]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T07:55:24.821 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a[29531]: 2024-09-05T07:55:24.370+0000 7f2858a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:24.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a[29531]: 2024-09-05T07:55:24.370+0000 7f2858a00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-05T07:55:24.822 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:24 smithi144 podman[85102]: 2024-09-05 07:55:24.596184684 +0000 UTC m=+0.363001677 container died 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-05T07:55:25.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:25 smithi144 podman[85102]: 2024-09-05 07:55:25.117742033 +0000 UTC m=+0.884559023 container cleanup 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-05T07:55:25.322 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:25 smithi144 bash[85102]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a 2024-09-05T07:55:25.649 INFO:journalctl@ceph.mon.a.smithi144.stdout:Sep 05 07:55:25 smithi144 podman[85113]: 2024-09-05 07:55:25.389445871 +0000 UTC m=+0.786496913 container remove 465f9df2cc5d07ebb0b9f72c1379f7570cd810246e14ad9cbfd466a7a6ecd3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-05T07:55:25.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.a.service' 2024-09-05T07:55:25.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:25.749 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-05T07:55:25.749 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-05T07:55:25.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.b 2024-09-05T07:55:26.085 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:25 smithi154 systemd[1]: Stopping Ceph mon.b for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:26.437 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-b[34706]: 2024-09-05T07:55:26.084+0000 7febf81ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:26.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-b[34706]: 2024-09-05T07:55:26.084+0000 7febf81ef640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-05T07:55:26.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:26 smithi154 podman[67021]: 2024-09-05 07:55:26.156367694 +0000 UTC m=+0.208309450 container died 2bbf37beacbb7a2aac0e7c2df8d3f64fe8ebac9f5d7141cb2559eddf75e2309d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-05T07:55:26.820 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:26 smithi154 podman[67021]: 2024-09-05 07:55:26.551929521 +0000 UTC m=+0.603871276 container cleanup 2bbf37beacbb7a2aac0e7c2df8d3f64fe8ebac9f5d7141cb2559eddf75e2309d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-05T07:55:26.820 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 05 07:55:26 smithi154 bash[67021]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-b 2024-09-05T07:55:26.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.b.service' 2024-09-05T07:55:27.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:27.028 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-05T07:55:27.028 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-05T07:55:27.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.c 2024-09-05T07:55:27.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 systemd[1]: Stopping Ceph mon.c for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:27.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c[34581]: 2024-09-05T07:55:27.372+0000 7fc8df970640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:27.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c[34581]: 2024-09-05T07:55:27.372+0000 7fc8df970640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-05T07:55:27.837 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 podman[68030]: 2024-09-05 07:55:27.578288386 +0000 UTC m=+0.355642142 container died 0b0e6120c976d3a028119c56fca2125080c12fdce9da82ef8a477461ebc7f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-05T07:55:28.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 podman[68030]: 2024-09-05 07:55:27.991547092 +0000 UTC m=+0.768900835 container cleanup 0b0e6120c976d3a028119c56fca2125080c12fdce9da82ef8a477461ebc7f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:55:28.218 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:27 smithi175 bash[68030]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c 2024-09-05T07:55:28.465 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.c.service' 2024-09-05T07:55:28.486 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:28 smithi175 podman[68042]: 2024-09-05 07:55:28.218443764 +0000 UTC m=+0.642794327 container remove 0b0e6120c976d3a028119c56fca2125080c12fdce9da82ef8a477461ebc7f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:55:28.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:28 smithi175 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-05T07:55:28.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:28 smithi175 systemd[1]: Stopped Ceph mon.c for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:55:28.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 05 07:55:28 smithi175 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mon.c.service: Consumed 9.065s CPU time. 2024-09-05T07:55:28.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:28.515 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-05T07:55:28.515 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-05T07:55:28.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T07:55:28.822 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:28 smithi144 systemd[1]: Stopping Ceph mgr.x for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:29.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:55:28.942+0000 7fa82bc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:29.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x[29760]: 2024-09-05T07:55:28.942+0000 7fa82bc00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-05T07:55:29.322 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:29 smithi144 podman[85218]: 2024-09-05 07:55:29.026073311 +0000 UTC m=+0.225669817 container died bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD) 2024-09-05T07:55:30.071 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:29 smithi144 podman[85218]: 2024-09-05 07:55:29.623703493 +0000 UTC m=+0.823299985 container cleanup bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:55:30.072 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:29 smithi144 bash[85218]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x 2024-09-05T07:55:30.072 INFO:journalctl@ceph.mgr.x.smithi144.stdout:Sep 05 07:55:29 smithi144 podman[85229]: 2024-09-05 07:55:29.842539886 +0000 UTC m=+0.807520433 container remove bad2796912867ee0092c0da6ada55c069efbe97927884fafc00fbd6ce74d8fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-05T07:55:30.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.x.service' 2024-09-05T07:55:30.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:30.201 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-05T07:55:30.202 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-05T07:55:30.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.y 2024-09-05T07:55:30.536 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:55:30 smithi154 systemd[1]: Stopping Ceph mgr.y for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:30.833 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:55:30 smithi154 podman[67143]: 2024-09-05 07:55:30.536799063 +0000 UTC m=+0.141370535 container died 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-05T07:55:31.134 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:55:30 smithi154 podman[67143]: 2024-09-05 07:55:30.933246964 +0000 UTC m=+0.537818439 container cleanup 7cbf6e0b8d0e21b310e25020a7edd1ef099aa9e5de26bfc3b8fb7f166f0beee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-05T07:55:31.135 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 05 07:55:30 smithi154 bash[67143]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-y 2024-09-05T07:55:31.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.y.service' 2024-09-05T07:55:31.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:31.382 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-05T07:55:31.382 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-05T07:55:31.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.z 2024-09-05T07:55:31.717 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:31 smithi175 systemd[1]: Stopping Ceph mgr.z for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:32.031 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:31 smithi175 podman[68149]: 2024-09-05 07:55:31.717527198 +0000 UTC m=+0.133486875 container died d797f555f2efe985a9b8c85151c73dffaae6475e95be2e84b9c125059210fa29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e) 2024-09-05T07:55:32.337 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:32 smithi175 podman[68149]: 2024-09-05 07:55:32.139467367 +0000 UTC m=+0.555427044 container cleanup d797f555f2efe985a9b8c85151c73dffaae6475e95be2e84b9c125059210fa29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-05T07:55:32.337 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:32 smithi175 bash[68149]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z 2024-09-05T07:55:32.608 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:32 smithi175 podman[68161]: 2024-09-05 07:55:32.358010076 +0000 UTC m=+0.636159358 container remove d797f555f2efe985a9b8c85151c73dffaae6475e95be2e84b9c125059210fa29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:55:32.609 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 05 07:55:32 smithi175 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-05T07:55:32.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mgr.z.service' 2024-09-05T07:55:32.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:32.648 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-05T07:55:32.648 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-05T07:55:32.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.0 2024-09-05T07:55:33.071 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:32 smithi144 systemd[1]: Stopping Ceph osd.0 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:33.571 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:55:33.073+0000 7f0ade800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:33.571 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:55:33.073+0000 7f0ade800640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-05T07:55:33.572 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0[43616]: 2024-09-05T07:55:33.073+0000 7f0ade800640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:55:38.805 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:38 smithi144 podman[85339]: 2024-09-05 07:55:38.507892793 +0000 UTC m=+5.575560266 container died 4c45f66758b3e164ad9b48be76e8d2869d7c9bb79e33dfcf29de7c4006acd5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-05T07:55:39.065 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:39 smithi144 podman[85339]: 2024-09-05 07:55:39.045453031 +0000 UTC m=+6.113120503 container cleanup 4c45f66758b3e164ad9b48be76e8d2869d7c9bb79e33dfcf29de7c4006acd5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-05T07:55:39.065 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:39 smithi144 bash[85339]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0 2024-09-05T07:55:39.322 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:39 smithi144 podman[85358]: 2024-09-05 07:55:39.297142757 +0000 UTC m=+0.770578639 container remove 4c45f66758b3e164ad9b48be76e8d2869d7c9bb79e33dfcf29de7c4006acd5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T07:55:40.176 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:39 smithi144 podman[85447]: 2024-09-05 07:55:39.76846544 +0000 UTC m=+0.026630347 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:55:40.176 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:39 smithi144 podman[85447]: 2024-09-05 07:55:39.889963956 +0000 UTC m=+0.148128865 container create 57cddea8bd571391799786ba69e0f784d1b4d6cbe9c08d0254013cf6210973ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-05T07:55:40.176 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:40 smithi144 podman[85447]: 2024-09-05 07:55:40.176230902 +0000 UTC m=+0.434395810 container init 57cddea8bd571391799786ba69e0f784d1b4d6cbe9c08d0254013cf6210973ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-05T07:55:40.445 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:40 smithi144 podman[85447]: 2024-09-05 07:55:40.182917826 +0000 UTC m=+0.441082733 container start 57cddea8bd571391799786ba69e0f784d1b4d6cbe9c08d0254013cf6210973ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T07:55:40.445 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:40 smithi144 podman[85447]: 2024-09-05 07:55:40.334551607 +0000 UTC m=+0.592716525 container attach 57cddea8bd571391799786ba69e0f784d1b4d6cbe9c08d0254013cf6210973ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-05T07:55:40.762 INFO:journalctl@ceph.osd.0.smithi144.stdout:Sep 05 07:55:40 smithi144 podman[85447]: 2024-09-05 07:55:40.445664115 +0000 UTC m=+0.703829039 container died 57cddea8bd571391799786ba69e0f784d1b4d6cbe9c08d0254013cf6210973ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-05T07:55:41.190 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.0.service' 2024-09-05T07:55:41.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:41.268 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-05T07:55:41.268 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-05T07:55:41.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.1 2024-09-05T07:55:41.588 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:41 smithi154 systemd[1]: Stopping Ceph osd.1 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:41.937 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:55:41.587+0000 7f1372f81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:41.937 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:55:41.587+0000 7f1372f81640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-05T07:55:41.937 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1[39128]: 2024-09-05T07:55:41.587+0000 7f1372f81640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:55:47.338 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:47 smithi154 podman[67270]: 2024-09-05 07:55:47.016382365 +0000 UTC m=+5.550048417 container died 1862267db18764ebbfa2a8576bf6a85bdca1877c9c54c66d0f467b9b06745bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:55:47.672 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:47 smithi154 podman[67270]: 2024-09-05 07:55:47.438215928 +0000 UTC m=+5.971881974 container cleanup 1862267db18764ebbfa2a8576bf6a85bdca1877c9c54c66d0f467b9b06745bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-05T07:55:47.673 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:47 smithi154 bash[67270]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1 2024-09-05T07:55:47.937 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:47 smithi154 podman[67286]: 2024-09-05 07:55:47.672988474 +0000 UTC m=+0.650948815 container remove 1862267db18764ebbfa2a8576bf6a85bdca1877c9c54c66d0f467b9b06745bd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-05T07:55:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.016287188 +0000 UTC m=+0.016258079 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:55:48.435 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.140784266 +0000 UTC m=+0.140755187 container create 237604fbb78982eb5f5425c13fa2261f81269f35f6a79102f1749fc51c160dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:55:48.687 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.435326324 +0000 UTC m=+0.435297206 container init 237604fbb78982eb5f5425c13fa2261f81269f35f6a79102f1749fc51c160dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:55:48.687 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.43873307 +0000 UTC m=+0.438703960 container start 237604fbb78982eb5f5425c13fa2261f81269f35f6a79102f1749fc51c160dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-05T07:55:48.688 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.518902493 +0000 UTC m=+0.518873380 container attach 237604fbb78982eb5f5425c13fa2261f81269f35f6a79102f1749fc51c160dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-05T07:55:48.688 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 05 07:55:48 smithi154 podman[67372]: 2024-09-05 07:55:48.626982454 +0000 UTC m=+0.626953353 container died 237604fbb78982eb5f5425c13fa2261f81269f35f6a79102f1749fc51c160dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-05T07:55:49.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.1.service' 2024-09-05T07:55:49.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:49.333 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-05T07:55:49.334 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-05T07:55:49.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.2 2024-09-05T07:55:49.643 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:49 smithi175 systemd[1]: Stopping Ceph osd.2 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:49.980 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:55:49.642+0000 7f0853d7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:49.980 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:55:49.642+0000 7f0853d7d640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-05T07:55:49.980 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2[39495]: 2024-09-05T07:55:49.642+0000 7f0853d7d640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:55:55.484 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:55 smithi175 podman[68273]: 2024-09-05 07:55:55.144377654 +0000 UTC m=+5.612298632 container died 32ce4d428d4a4b467f48dc5db71daadc02f1c5fa14be3e0273d1a46c3018be21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-05T07:55:55.485 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:55 smithi175 podman[68273]: 2024-09-05 07:55:55.484857094 +0000 UTC m=+5.952778071 container cleanup 32ce4d428d4a4b467f48dc5db71daadc02f1c5fa14be3e0273d1a46c3018be21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-05T07:55:55.837 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:55 smithi175 bash[68273]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2 2024-09-05T07:55:55.837 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:55 smithi175 podman[68301]: 2024-09-05 07:55:55.720398466 +0000 UTC m=+0.573066301 container remove 32ce4d428d4a4b467f48dc5db71daadc02f1c5fa14be3e0273d1a46c3018be21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-05T07:55:56.457 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.050156337 +0000 UTC m=+0.015882405 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:55:56.457 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.18798085 +0000 UTC m=+0.153706902 container create 6c6e5962fb352dddbb6de36923da11941850ce7a596e8ab09234109b3aef9b18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-05T07:55:56.457 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.457347695 +0000 UTC m=+0.423073749 container init 6c6e5962fb352dddbb6de36923da11941850ce7a596e8ab09234109b3aef9b18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-05T07:55:56.837 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.460910165 +0000 UTC m=+0.426636224 container start 6c6e5962fb352dddbb6de36923da11941850ce7a596e8ab09234109b3aef9b18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2-deactivate, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-05T07:55:56.837 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.57427834 +0000 UTC m=+0.540004405 container attach 6c6e5962fb352dddbb6de36923da11941850ce7a596e8ab09234109b3aef9b18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-91c8a7e) 2024-09-05T07:55:56.837 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 05 07:55:56 smithi175 podman[68392]: 2024-09-05 07:55:56.647523879 +0000 UTC m=+0.613249932 container died 6c6e5962fb352dddbb6de36923da11941850ce7a596e8ab09234109b3aef9b18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-2-deactivate, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-05T07:55:57.273 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.2.service' 2024-09-05T07:55:57.312 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:55:57.313 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-05T07:55:57.313 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-05T07:55:57.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.3 2024-09-05T07:55:57.743 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:55:57 smithi144 systemd[1]: Stopping Ceph osd.3 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:55:58.071 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:55:57 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:55:57.742+0000 7f61de600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:55:58.072 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:55:57 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:55:57.742+0000 7f61de600640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-05T07:55:58.072 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:55:57 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:55:57.742+0000 7f61de600640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:55:59.398 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:55:59 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:55:59.201+0000 7f61d5000640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.251936+0000 front 2024-09-05T07:55:35.252138+0000 (oldest deadline 2024-09-05T07:55:58.752150+0000) 2024-09-05T07:56:00.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:55:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:55:59.995+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:00.571 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:56:00.232+0000 7f61d5000640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.251936+0000 front 2024-09-05T07:55:35.252138+0000 (oldest deadline 2024-09-05T07:55:58.752150+0000) 2024-09-05T07:56:01.263 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:00 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:00.918+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:01.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:00.959+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:01.571 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:01 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:56:01.262+0000 7f61d5000640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.251936+0000 front 2024-09-05T07:55:35.252138+0000 (oldest deadline 2024-09-05T07:55:58.752150+0000) 2024-09-05T07:56:01.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:01 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:01.290+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:02.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:01.937+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:02.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:01.690+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:02.250 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:01 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:01.884+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:02.571 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3[50235]: 2024-09-05T07:56:02.260+0000 7f61d5000640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.251936+0000 front 2024-09-05T07:55:35.252138+0000 (oldest deadline 2024-09-05T07:55:58.752150+0000) 2024-09-05T07:56:02.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:02.249+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:03.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:02.909+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:03.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:02.737+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:03.207 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:02 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:02.846+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:03.571 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:03 smithi144 podman[85548]: 2024-09-05 07:56:03.288682228 +0000 UTC m=+5.685478429 container died 59e2c52bfac015ca551c280d87d14744a0d82c1758787e62b5c11721a9449fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-05T07:56:03.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:03.206+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:04.072 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:03 smithi144 podman[85548]: 2024-09-05 07:56:03.79031169 +0000 UTC m=+6.187107887 container cleanup 59e2c52bfac015ca551c280d87d14744a0d82c1758787e62b5c11721a9449fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T07:56:04.072 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:03 smithi144 bash[85548]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3 2024-09-05T07:56:04.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:03 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:03.814+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:04.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:03.864+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:04.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:03.717+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:04.560 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85576]: 2024-09-05 07:56:04.083272512 +0000 UTC m=+0.785896902 container remove 59e2c52bfac015ca551c280d87d14744a0d82c1758787e62b5c11721a9449fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.vendor=CentOS) 2024-09-05T07:56:04.561 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:04.167+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:04.822 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85661]: 2024-09-05 07:56:04.464343884 +0000 UTC m=+0.027707623 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:04.822 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85661]: 2024-09-05 07:56:04.592588388 +0000 UTC m=+0.155952127 container create db47d1d340bb374336c010dafcd021256128d480c9937a0136e076b5b3b8a983 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:56:05.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:04.855+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:05.093 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:04.695+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:05.114 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85661]: 2024-09-05 07:56:04.845434175 +0000 UTC m=+0.408797914 container init db47d1d340bb374336c010dafcd021256128d480c9937a0136e076b5b3b8a983 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e) 2024-09-05T07:56:05.114 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85661]: 2024-09-05 07:56:04.852153811 +0000 UTC m=+0.415517559 container start db47d1d340bb374336c010dafcd021256128d480c9937a0136e076b5b3b8a983 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.license=GPLv2) 2024-09-05T07:56:05.114 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:04 smithi144 podman[85661]: 2024-09-05 07:56:04.94524804 +0000 UTC m=+0.508611796 container attach db47d1d340bb374336c010dafcd021256128d480c9937a0136e076b5b3b8a983 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:56:05.114 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:04 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:04.838+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:05.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:04 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:04.855+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:05.423 INFO:journalctl@ceph.osd.3.smithi144.stdout:Sep 05 07:56:05 smithi144 podman[85661]: 2024-09-05 07:56:05.104664556 +0000 UTC m=+0.668028304 container died db47d1d340bb374336c010dafcd021256128d480c9937a0136e076b5b3b8a983 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:56:05.424 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:05 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:05.153+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:05.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.3.service' 2024-09-05T07:56:05.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:05.836 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-05T07:56:05.836 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-05T07:56:05.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.4 2024-09-05T07:56:06.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:05 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:05.827+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:06.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:05.831+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:06.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:05.733+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:06.159 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:05 smithi154 systemd[1]: Stopping Ceph osd.4 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:06.159 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:05 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:05.875+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:06.437 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:06 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:56:06.158+0000 7f5784f77640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:06.437 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:06 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:56:06.158+0000 7f5784f77640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-05T07:56:06.437 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:06 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:56:06.158+0000 7f5784f77640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:06.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:06.125+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:07.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:06.787+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:07.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:06.764+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:07.163 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:06 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:06.847+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:07.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:06 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:06.856+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:07.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:07 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:07.163+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:07.688 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:07 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:07.258+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:08.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:07.809+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:08.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:07 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:07.768+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:08.130 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:07 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:07.844+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:08.130 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:07 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:07.844+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:08.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:07 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:07.855+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:08.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:08 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:08.129+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:08.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:08 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:08.225+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:09.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:08 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:08.844+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:09.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:08 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:08.774+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:09.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:08 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:08.774+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:09.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:08 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:08.849+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:09.321 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:09 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:09.112+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:09.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:08 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:08.876+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:09.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:08 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:08.876+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:09.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:09.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:09.817 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:09.403+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:10.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:09 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:09.850+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:10.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:09 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:09.850+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:10.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:09.893+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:10.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:09.893+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:10.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:09.816+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:10.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:09 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:09.816+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:10.169 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:09.835+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:10.169 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:09 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:09.835+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:10.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:10 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:10.169+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:10.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:10.114+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:10.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:10.114+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:10.776 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:10.424+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:11.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:10.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:11.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:10.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:11.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:10.875+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:11.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:10.875+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:11.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:10.776+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:11.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:10 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:10.776+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:11.179 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:10 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4[45860]: 2024-09-05T07:56:10.807+0000 7f578158d640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.485143+0000 front 2024-09-05T07:55:45.485220+0000 (oldest deadline 2024-09-05T07:56:10.785265+0000) 2024-09-05T07:56:11.179 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:10 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:10.819+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:11.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:10 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:10.819+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:11.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:11.179+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:11.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:11 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:11.097+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:11.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:11 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:11.097+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:11.742 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:11.467+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:11.937 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:11 smithi154 podman[67497]: 2024-09-05 07:56:11.666949178 +0000 UTC m=+5.628027613 container died dc90a6560733c0469fc40af1c6ea4c243bc47684c3f95ca5245b6229f6455ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-05T07:56:11.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:11.779+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:11.938 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:11 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:11.779+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:12.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:11 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:11.795+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:12.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:11 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:11.795+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:12.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:11.881+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:12.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:11.881+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:12.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:11.742+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:12.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:11 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:11.742+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:12.336 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:12 smithi154 podman[67497]: 2024-09-05 07:56:12.100794959 +0000 UTC m=+6.061873393 container cleanup dc90a6560733c0469fc40af1c6ea4c243bc47684c3f95ca5245b6229f6455ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD) 2024-09-05T07:56:12.336 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:12 smithi154 bash[67497]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4 2024-09-05T07:56:12.336 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:12.179+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:12.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:12 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:12.111+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:12.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:12 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:12.111+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:12.687 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:12 smithi154 podman[67514]: 2024-09-05 07:56:12.335762438 +0000 UTC m=+0.665270582 container remove dc90a6560733c0469fc40af1c6ea4c243bc47684c3f95ca5245b6229f6455ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-05T07:56:12.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:12 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:12.458+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:12.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:12 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:12.693+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:12.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:12 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:12.693+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:13.048 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:12.749+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:13.048 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:12 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:12.749+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:13.048 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:12 smithi154 podman[67603]: 2024-09-05 07:56:12.645837749 +0000 UTC m=+0.015919678 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:13.048 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:12 smithi154 podman[67603]: 2024-09-05 07:56:12.76183063 +0000 UTC m=+0.131912546 container create f00de25448da42b6820e27fcc2639d6928fbd79448e3583852826454a9254d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-05T07:56:13.048 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:13 smithi154 podman[67603]: 2024-09-05 07:56:13.048159898 +0000 UTC m=+0.418241813 container init f00de25448da42b6820e27fcc2639d6928fbd79448e3583852826454a9254d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e) 2024-09-05T07:56:13.070 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:12 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:12.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:13.070 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:12 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:12.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:13.321 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:13.069+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:13.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:13.069+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:13.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:12 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:12.893+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:13.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:12 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:12.893+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:13.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:13 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:13.181+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:13.437 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:13 smithi154 podman[67603]: 2024-09-05 07:56:13.051601245 +0000 UTC m=+0.421683165 container start f00de25448da42b6820e27fcc2639d6928fbd79448e3583852826454a9254d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T07:56:13.438 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:13 smithi154 podman[67603]: 2024-09-05 07:56:13.156544236 +0000 UTC m=+0.526626171 container attach f00de25448da42b6820e27fcc2639d6928fbd79448e3583852826454a9254d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-05T07:56:13.438 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 05 07:56:13 smithi154 podman[67603]: 2024-09-05 07:56:13.234889196 +0000 UTC m=+0.604971113 container died f00de25448da42b6820e27fcc2639d6928fbd79448e3583852826454a9254d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T07:56:13.741 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:13 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:13.418+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:13.860 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:13 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:13.712+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:13.860 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:13 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:13.712+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:13.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.4.service' 2024-09-05T07:56:13.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:13.935 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-05T07:56:13.935 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-05T07:56:13.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.5 2024-09-05T07:56:14.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:13 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:13.741+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:14.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:13 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:13.741+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:14.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:13 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:13.904+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:14.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:13 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:13.904+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:14.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:13 smithi175 systemd[1]: Stopping Ceph osd.5 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:14.321 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:14 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:14.047+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:14.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:14 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:14.047+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:14.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:13.826+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:14.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:13.826+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:14.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:14 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:14.182+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:14.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:14.443+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:14.587 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:14.238+0000 7fbef6dff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:14.587 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:14.238+0000 7fbef6dff640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-05T07:56:14.587 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:14.238+0000 7fbef6dff640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:15.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:14 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:14.801+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:15.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:14 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:14.801+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:15.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:14.931+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:15.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:14.931+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:15.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:14.720+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:15.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:14 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:14.720+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:15.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:14 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:14.752+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:15.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:14 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:14.752+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:15.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:15.144+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:15.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:15.082+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:15.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:15.082+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:15.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:15.479+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:15.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:15.722+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:15.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:15.722+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:16.101 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:15.743+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:16.101 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:15 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:15.743+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:16.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:15.851+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:16.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:15 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:15.851+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:16.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:16 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:16.082+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:16.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:16 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:16.082+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:16.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:15.931+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:16.337 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:15 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:15.931+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:16.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:16 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:16.101+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:16.742 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:16.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:17.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:16.741+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:17.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:16.741+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:17.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:16.970+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:17.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:16.970+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:17.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:16 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:16.970+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.698864+0000 front 2024-09-05T07:55:49.698909+0000 (oldest deadline 2024-09-05T07:56:16.699519+0000) 2024-09-05T07:56:17.112 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:16 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:16.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:17.112 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:16 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:16.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:17.321 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:17.105+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:17.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:17.105+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:17.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:16 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:16.880+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:17.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:16 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:16.880+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:17.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:17 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:17.112+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:17.776 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:17 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:17.480+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:18.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:17 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:17.776+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:18.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:17 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:17.776+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:18.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:18.002+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:18.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:18.002+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:18.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:18.002+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.698864+0000 front 2024-09-05T07:55:49.698909+0000 (oldest deadline 2024-09-05T07:56:16.699519+0000) 2024-09-05T07:56:18.128 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:17 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:17.828+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:18.128 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:17 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:17.828+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:18.321 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:18 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:18.085+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:18.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:18 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:18.085+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:18.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:17.842+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:18.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:17.842+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:18.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:18 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:18.128+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:18.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:18 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:18.128+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:18.825 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:18.490+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:18.825 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:18.490+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:19.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:19.031+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:37.496912+0000 front 2024-09-05T07:55:37.497063+0000 (oldest deadline 2024-09-05T07:55:59.796818+0000) 2024-09-05T07:56:19.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:19.031+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.598613+0000 front 2024-09-05T07:55:45.598663+0000 (oldest deadline 2024-09-05T07:56:09.698444+0000) 2024-09-05T07:56:19.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5[46222]: 2024-09-05T07:56:19.031+0000 7fbef3415640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.698864+0000 front 2024-09-05T07:55:49.698909+0000 (oldest deadline 2024-09-05T07:56:16.699519+0000) 2024-09-05T07:56:19.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:18.824+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:19.088 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:18.824+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:19.088 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:18 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:18.824+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:19.106 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:18 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:18.846+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:19.106 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:18 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:18.846+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:19.106 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:18 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:18.846+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:19.173 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:18 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:18.812+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:19.174 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:18 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:18.812+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:19.174 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:18 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:18.812+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:19.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:19.173+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:19.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:19.173+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:19.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:19 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:19.106+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:19.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:19 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:19.106+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:19.794 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:19.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:19.794 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:19.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:20.087 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:19 smithi175 podman[68496]: 2024-09-05 07:56:19.7939809 +0000 UTC m=+5.667136815 container died 8eeed516a5da39dc43deb102e9695a2576cee42ba1f10f14d4a2e6fc4e15a69f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-05T07:56:20.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:19.802+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:20.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:19.802+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:20.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:19 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:19.802+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:20.129 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:19 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:19.826+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:20.129 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:19 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:19.826+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:20.129 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:19 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:19.826+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:20.159 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:19.823+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:20.159 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:19.823+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:20.159 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:19 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:19.823+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:20.340 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:20 smithi175 podman[68496]: 2024-09-05 07:56:20.188858577 +0000 UTC m=+6.062014493 container cleanup 8eeed516a5da39dc43deb102e9695a2576cee42ba1f10f14d4a2e6fc4e15a69f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-05T07:56:20.340 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:20 smithi175 bash[68496]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5 2024-09-05T07:56:20.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:20 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:20.159+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:20.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:20 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:20.159+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:20.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:20 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:20.129+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:20.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:20 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:20.129+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:20.758 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:20 smithi175 podman[68524]: 2024-09-05 07:56:20.482471648 +0000 UTC m=+0.686726851 container remove 8eeed516a5da39dc43deb102e9695a2576cee42ba1f10f14d4a2e6fc4e15a69f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-05T07:56:20.759 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:20.475+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:20.759 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:20.475+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:21.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:20.758+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:21.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:20.758+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:21.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:20 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:20.758+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:21.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:20 smithi175 podman[68613]: 2024-09-05 07:56:20.7253594 +0000 UTC m=+0.015718786 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:21.088 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:20 smithi175 podman[68613]: 2024-09-05 07:56:20.850342223 +0000 UTC m=+0.140701596 container create a743126d9dc95d7d10db6a413a583b53bdfe4cb6c7ee95a44235672a63b39cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True) 2024-09-05T07:56:21.121 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:20 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:20.839+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:21.121 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:20 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:20.839+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:21.121 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:20 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:20.839+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:21.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:20 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:20.858+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:21.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:20 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:20.858+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:21.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:20 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:20.858+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:21.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:21 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:21.180+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:21.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:21 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:21.180+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:21.465 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:21 smithi175 podman[68613]: 2024-09-05 07:56:21.111142758 +0000 UTC m=+0.401502131 container init a743126d9dc95d7d10db6a413a583b53bdfe4cb6c7ee95a44235672a63b39cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:56:21.466 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:21 smithi175 podman[68613]: 2024-09-05 07:56:21.114384667 +0000 UTC m=+0.404744047 container start a743126d9dc95d7d10db6a413a583b53bdfe4cb6c7ee95a44235672a63b39cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:56:21.466 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:21 smithi175 podman[68613]: 2024-09-05 07:56:21.169551557 +0000 UTC m=+0.459910956 container attach a743126d9dc95d7d10db6a413a583b53bdfe4cb6c7ee95a44235672a63b39cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e) 2024-09-05T07:56:21.466 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 05 07:56:21 smithi175 podman[68613]: 2024-09-05 07:56:21.299161548 +0000 UTC m=+0.589520937 container died a743126d9dc95d7d10db6a413a583b53bdfe4cb6c7ee95a44235672a63b39cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-05T07:56:21.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:21.120+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:21.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:21.120+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:21.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:21.120+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:21.750 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:21 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:21.465+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:21.750 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:21 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:21.465+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:21.879 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.5.service' 2024-09-05T07:56:21.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:21.919 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-05T07:56:21.919 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-05T07:56:21.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.6 2024-09-05T07:56:22.071 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 systemd[1]: Stopping Ceph osd.6 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:22.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:21.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:22.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:21.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:22.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:21.805+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:22.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:21 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:21.749+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:22.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:21 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:21.749+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:22.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:21 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:21.749+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:22.170 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:21 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:21.810+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:22.170 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:21 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:21.810+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:22.170 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:21 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:21.810+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:22.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:22 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:22.169+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:22.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:22 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:22.169+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.143+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.143+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.143+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.344+0000 7f9dce200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.344+0000 7f9dce200640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-05T07:56:22.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:22.344+0000 7f9dce200640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:22.751 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:22 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:22.491+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:22.751 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:22 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:22.491+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:23.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:22 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:22.751+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:23.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:22 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:22.751+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:23.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:22 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:22.751+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:23.103 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:22.851+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:23.104 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:22.851+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:23.104 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:22 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:22.851+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:23.185 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:22 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:22.763+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:23.185 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:22 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:22.763+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:23.185 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:22 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:22.763+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:23.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:23 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:23.184+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:23.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:23 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:23.184+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:23.571 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:23.103+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:23.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:23.103+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:23.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:23.103+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:23.715 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:23 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:23.457+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:23.715 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:23 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:23.457+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:24.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:23 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:23.715+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:24.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:23 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:23.715+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:24.087 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:23 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:23.715+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:24.136 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:23.859+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:24.137 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:23.859+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:24.137 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:23.859+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:24.137 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:23 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:23.859+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:24.186 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:23 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:23.807+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:24.186 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:23 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:23.807+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:24.186 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:23 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:23.807+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:24.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:24.186+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:24.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:24.186+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:24.437 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:24.186+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:24.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:24.136+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:24.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:24.136+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:24.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:24.136+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:24.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:24.136+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:00.995362+0000 front 2024-09-05T07:56:00.995340+0000 (oldest deadline 2024-09-05T07:56:23.895333+0000) 2024-09-05T07:56:24.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:24.468+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:24.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:24.468+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:24.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:24.468+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:24.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:24.671+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:24.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:24.671+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:24.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:24 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:24.671+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:25.120 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:24.829+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:25.120 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:24.829+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:25.120 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:24.829+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:25.120 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:24 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:24.829+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:25.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:24.775+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:25.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:24.775+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:25.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:24.775+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:25.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:25.119+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:25.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:25.119+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:25.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:25.119+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:25.572 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:25.119+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:00.995362+0000 front 2024-09-05T07:56:00.995340+0000 (oldest deadline 2024-09-05T07:56:23.895333+0000) 2024-09-05T07:56:25.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:25.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:25.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:25.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:25.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:25.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:25.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:25.435+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:25.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:25.435+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:25.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:25.435+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:25.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:25.628+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:25.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:25.628+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:25.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:25.628+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:25.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:25 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:25.628+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:26.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:25.794+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:26.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:25.794+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:26.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:25.794+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:26.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:25 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:25.794+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:26.072+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:26.072+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:26.072+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:26.072+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:00.995362+0000 front 2024-09-05T07:56:00.995340+0000 (oldest deadline 2024-09-05T07:56:23.895333+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:25.852+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:25.852+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:25.852+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:26.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:25 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:25.852+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:26.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:26.232+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:26.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:26.232+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:26.688 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:26.232+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:26.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:26.440+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:26.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:26.440+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:26.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:26.440+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:26.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:26.584+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:26.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:26.584+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:26.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:26.584+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:26.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:26 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:26.584+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:27.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:26.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:27.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:26.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:27.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:26.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:27.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:26 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:26.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:27.224 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:27.061+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:35.192454+0000 front 2024-09-05T07:55:35.192176+0000 (oldest deadline 2024-09-05T07:56:01.092232+0000) 2024-09-05T07:56:27.224 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:27.061+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.293915+0000 front 2024-09-05T07:55:46.293951+0000 (oldest deadline 2024-09-05T07:56:09.193856+0000) 2024-09-05T07:56:27.224 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:27.061+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.194660+0000 front 2024-09-05T07:55:49.194333+0000 (oldest deadline 2024-09-05T07:56:20.994948+0000) 2024-09-05T07:56:27.225 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6[56722]: 2024-09-05T07:56:27.061+0000 7f9dc4c00640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:00.995362+0000 front 2024-09-05T07:56:00.995340+0000 (oldest deadline 2024-09-05T07:56:23.895333+0000) 2024-09-05T07:56:27.225 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:26.873+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:27.225 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:26.873+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:27.225 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:26.873+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:27.225 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:26 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:26.873+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:27.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:27.271+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:27.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:27.271+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:27.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:27.271+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:27.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:27.466+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:27.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:27.466+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:27.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:27.466+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:27.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:27.536+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:27.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:27.536+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:27.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:27.536+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:27.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:27 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:27.536+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:28.072 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:27 smithi144 podman[85763]: 2024-09-05 07:56:27.806366979 +0000 UTC m=+5.590765736 container died f815725204fc5f651a352a51db5c10a15f5b3fa67ada54c2f18438d7a08a5bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:56:28.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:27.866+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:28.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:27.866+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:28.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:27.866+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:28.072 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:27 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:27.866+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:28.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:27.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:28.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:27.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:28.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:27.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:28.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:27 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:27.785+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:28.543 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:28 smithi144 podman[85763]: 2024-09-05 07:56:28.309151337 +0000 UTC m=+6.093550092 container cleanup f815725204fc5f651a352a51db5c10a15f5b3fa67ada54c2f18438d7a08a5bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T07:56:28.543 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:28 smithi144 bash[85763]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6 2024-09-05T07:56:28.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:28.223+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:28.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:28.223+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:28.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:28.223+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:28.821 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:28 smithi144 podman[85780]: 2024-09-05 07:56:28.543212969 +0000 UTC m=+0.727275451 container remove f815725204fc5f651a352a51db5c10a15f5b3fa67ada54c2f18438d7a08a5bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:56:28.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:28.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:28.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:28.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:28.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:28.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:28.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:28.487+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:28.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:28.487+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:28.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:28.487+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:28.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:28 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:28.487+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:29.148 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:28 smithi144 podman[85865]: 2024-09-05 07:56:28.99390474 +0000 UTC m=+0.118741044 container create bbad6cd482163d81b0bb84d9e692dac4a7e950520b2b2bc44d85ef1740ac37ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-05T07:56:29.149 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:28 smithi144 podman[85865]: 2024-09-05 07:56:28.902648622 +0000 UTC m=+0.027484926 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:29.149 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:28.896+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:29.149 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:28.896+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:29.149 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:28.896+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:29.150 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:28 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:28.896+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:29.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:28.818+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:29.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:28.818+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:29.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:28.818+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:29.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:28 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:28.818+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:29.567 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:29 smithi144 podman[85865]: 2024-09-05 07:56:29.30535091 +0000 UTC m=+0.430187238 container init bbad6cd482163d81b0bb84d9e692dac4a7e950520b2b2bc44d85ef1740ac37ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T07:56:29.567 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:29 smithi144 podman[85865]: 2024-09-05 07:56:29.31225046 +0000 UTC m=+0.437086770 container start bbad6cd482163d81b0bb84d9e692dac4a7e950520b2b2bc44d85ef1740ac37ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-05T07:56:29.568 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:29 smithi144 podman[85865]: 2024-09-05 07:56:29.388470715 +0000 UTC m=+0.513307030 container attach bbad6cd482163d81b0bb84d9e692dac4a7e950520b2b2bc44d85ef1740ac37ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e) 2024-09-05T07:56:29.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:29.231+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:29.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:29.231+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:29.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:29.231+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:29.821 INFO:journalctl@ceph.osd.6.smithi144.stdout:Sep 05 07:56:29 smithi144 podman[85865]: 2024-09-05 07:56:29.567911206 +0000 UTC m=+0.692747520 container died bbad6cd482163d81b0bb84d9e692dac4a7e950520b2b2bc44d85ef1740ac37ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e) 2024-09-05T07:56:29.829 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:29.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:29.829 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:29.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:29.829 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:29.485+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:29.829 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:29.524+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:29.830 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:29.524+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:29.830 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:29.524+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:29.830 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:29 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:29.524+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:30.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:29.808+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:30.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:29.808+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:30.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:29.808+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:30.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:29.808+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:30.242 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:29 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:29.937+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:30.242 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:29 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:29.937+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:30.242 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:29 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:29.937+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:30.242 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:29 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:29.937+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:30.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.6.service' 2024-09-05T07:56:30.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:30.349 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-05T07:56:30.349 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-05T07:56:30.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.7 2024-09-05T07:56:30.473 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.210+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:30.474 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.210+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:30.474 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.210+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:30.474 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 systemd[1]: Stopping Ceph osd.7 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:30.841 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:30.482+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:30.841 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:30.482+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:30.841 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:30.482+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:30.529+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:30.529+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:30.529+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:30 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:30.529+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.702+0000 7fbc30fd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:30.842 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.703+0000 7fbc30fd0640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-05T07:56:30.843 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:30.703+0000 7fbc30fd0640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:31.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:30.840+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:31.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:30.840+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:31.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:30.840+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:31.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:30 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:30.840+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:31.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:30 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:30.958+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:31.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:30 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:30.958+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:31.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:30 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:30.958+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:31.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:30 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:30.958+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:31.467 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:31.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:31.467 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:31.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:31.468 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:31.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:31.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:31.521+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:31.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:31.521+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:31.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:31.521+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:31.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:31.533+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:31.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:31.533+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:31.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:31.533+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:31.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:31 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:31.533+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:32.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:31.882+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:32.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:31.882+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:32.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:31.882+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:32.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:31 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:31.882+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:32.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:31.978+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:32.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:31.978+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:32.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:31.978+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:32.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:31 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:31.978+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:32.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:32.250+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:32.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:32.250+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:32.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:32.250+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:32.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:32.516+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:32.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:32.516+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:32.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:32.516+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:32.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:32.516+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:32.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:32.562+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:32.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:32.562+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:32.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:32.562+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:32.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:32 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:32.562+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:33.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:32.921+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:33.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:32.921+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:33.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:32.921+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:33.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:32 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:32.921+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:33.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:33.010+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:33.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:33.010+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:33.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:33.010+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:33.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:33.010+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:33.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:33 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:33.010+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:33.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:33.234+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:33.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:33.234+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:33.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:33.234+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:33.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:33.467+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:33.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:33.467+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:33.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:33.467+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:33.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:33.467+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:33.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:33.570+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:33.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:33.570+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:33.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:33.570+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:33.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:33 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:33.570+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:34.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:33.905+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:34.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:33.905+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:34.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:33.905+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:34.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:33.905+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:34.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:33.905+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:34.326 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:34.017+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:34.326 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:34.017+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:34.326 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:34.017+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:34.326 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:34.017+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:34.326 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:34 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:34.017+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:34.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:34.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:34.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:34.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:34.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:34.206+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:34.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:34.504+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:34.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:34.504+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:34.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:34.504+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:34.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:34.504+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:34.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:34.547+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:34.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:34.547+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:34.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:34.547+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:34.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:34 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:34.547+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:35.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.034+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:35.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.034+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:35.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.034+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:35.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.034+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:35.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.034+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:35.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:34.949+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:35.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:34.949+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:35.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:34.949+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:34.949+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:34 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:34.949+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:35.194+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.725536+0000 front 2024-09-05T07:55:44.725605+0000 (oldest deadline 2024-09-05T07:56:07.025665+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:35.194+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426834+0000 front 2024-09-05T07:55:53.426752+0000 (oldest deadline 2024-09-05T07:56:17.526883+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:35.194+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.728360+0000 front 2024-09-05T07:56:02.728405+0000 (oldest deadline 2024-09-05T07:56:23.828397+0000) 2024-09-05T07:56:35.438 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7[52320]: 2024-09-05T07:56:35.194+0000 7fbc295de640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.130326+0000 front 2024-09-05T07:56:10.130284+0000 (oldest deadline 2024-09-05T07:56:34.230423+0000) 2024-09-05T07:56:35.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:35.506+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:35.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:35.506+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:35.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:35.506+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:35.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:35.506+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:35.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:35.590+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:35.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:35.590+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:35.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:35.590+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:35.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:35.590+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:35.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:35 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:35.590+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:36.189 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:36 smithi154 podman[67704]: 2024-09-05 07:56:36.044310108 +0000 UTC m=+5.464333104 container died 354db11f992cd7445a4b9141c8b2b888412e328a974f3ef074d7dcde19eb9fa3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T07:56:36.189 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:35.926+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:36.189 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:35.926+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:36.189 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:35.926+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:36.190 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:35.926+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:36.190 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:35 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:35.926+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:36.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.989+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:36.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.989+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:36.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.989+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:36.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.989+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:36.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:35 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:35.989+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:36.672 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:36 smithi154 podman[67704]: 2024-09-05 07:56:36.454146219 +0000 UTC m=+5.874169215 container cleanup 354db11f992cd7445a4b9141c8b2b888412e328a974f3ef074d7dcde19eb9fa3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-05T07:56:36.672 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:36 smithi154 bash[67704]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7 2024-09-05T07:56:36.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:36.528+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:36.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:36.528+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:36.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:36.528+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:36.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:36.528+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:36.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:36.586+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:36.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:36.586+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:36.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:36.586+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:36.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:36.586+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:36.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:36 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:36.586+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:36.937 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:36 smithi154 podman[67730]: 2024-09-05 07:56:36.672012769 +0000 UTC m=+0.619624511 container remove 354db11f992cd7445a4b9141c8b2b888412e328a974f3ef074d7dcde19eb9fa3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T07:56:36.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:36 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:36.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:36.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:36 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:36.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:36.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:36 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:36.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:36.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:36 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:36.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:36.938 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:36 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:36.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:37.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:36.965+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:37.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:36.965+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:37.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:36.965+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:37.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:36.965+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:37.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:36 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:36.965+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:37.425 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:36.982469676 +0000 UTC m=+0.015682306 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:37.425 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:37.098028432 +0000 UTC m=+0.131241104 container create a1cbc18da548972b9f79523ee103c50fbea628c7aa19bf0b78c7643e31ae8998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-05T07:56:37.426 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:37.325348568 +0000 UTC m=+0.358561197 container init a1cbc18da548972b9f79523ee103c50fbea628c7aa19bf0b78c7643e31ae8998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-05T07:56:37.426 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:37.328881656 +0000 UTC m=+0.362094292 container start a1cbc18da548972b9f79523ee103c50fbea628c7aa19bf0b78c7643e31ae8998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731) 2024-09-05T07:56:37.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:37.425770738 +0000 UTC m=+0.458983368 container attach a1cbc18da548972b9f79523ee103c50fbea628c7aa19bf0b78c7643e31ae8998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:56:37.687 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 05 07:56:37 smithi154 podman[67822]: 2024-09-05 07:56:37.518675326 +0000 UTC m=+0.551887955 container died a1cbc18da548972b9f79523ee103c50fbea628c7aa19bf0b78c7643e31ae8998 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, ceph=True) 2024-09-05T07:56:37.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:37.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:37.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:37.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:37.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:37.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:37.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:37.484+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:37.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:37.558+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:37.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:37.558+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:37.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:37.558+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:37.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:37.558+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:37.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:37 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:37.558+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:38.137 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:37.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:38.137 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:37.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:38.137 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:37.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:38.137 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:37.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:38.137 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:37.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:38.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.7.service' 2024-09-05T07:56:38.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:38.198 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-05T07:56:38.198 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-05T07:56:38.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.8 2024-09-05T07:56:38.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:37.983+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:38.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:37.983+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:38.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:37.983+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:38.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:37.983+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:38.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:37 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:37.983+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:38.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 systemd[1]: Stopping Ceph osd.8 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:38.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:38.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:38.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.515+0000 7f3e477fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.515+0000 7f3e477fd640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-05T07:56:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:38.515+0000 7f3e477fd640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:38.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:38.555+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:38.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:38.555+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:38.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:38.555+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:38.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:38.555+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:38.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:38 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:38.555+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:39.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:38 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:38.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:39.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:38 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:38.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:39.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:38 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:38.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:39.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:38 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:38.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:39.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:38 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:38.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:39.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.032+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:39.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.032+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:39.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.032+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:39.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.032+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:39.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.032+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:39.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:39.417+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:39.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:39.417+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:39.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:39.417+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:39.417+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:39.519+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:39.519+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:39.519+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:39.519+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:39.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:39 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:39.519+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:40.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.991+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:40.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.991+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:40.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.991+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:40.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.991+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:40.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:39 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:39.991+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:40.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:39 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:39.967+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:40.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:39 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:39.967+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:40.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:39 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:39.967+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:40.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:39 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:39.967+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:40.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:39 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:39.967+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:40.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:40.444+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:40.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:40.444+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:40.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:40.444+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:40.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:40.444+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:40.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:40.501+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:40.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:40.501+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:40.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:40.501+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:40.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:40.501+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:40.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:40 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:40.501+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:41.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:40 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:40.977+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:41.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:40 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:40.977+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:41.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:40 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:40.977+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:41.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:40 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:40.977+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:41.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:40 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:40.977+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:41.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:40 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:40.940+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:41.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:40 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:40.940+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:41.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:40 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:40.940+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:41.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:40 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:40.940+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:41.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:40 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:40.940+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:41.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:41.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:41.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:41.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:41.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:41.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:41.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:41.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:41.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:41.454+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.802203+0000 front 2024-09-05T07:56:14.802185+0000 (oldest deadline 2024-09-05T07:56:40.702303+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:41.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:41.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:42.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:42.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:42.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:42.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:42.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:42.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:41 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:41.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:42.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.004+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:42.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.004+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:42.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.004+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:42.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.004+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:42.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.004+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:42.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:42.428+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:42.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:42.428+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:42.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:42.428+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:42.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:42.428+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:42.428+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.802203+0000 front 2024-09-05T07:56:14.802185+0000 (oldest deadline 2024-09-05T07:56:40.702303+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:42.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:42.839 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:42 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:42.443+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:43.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:43.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:43.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:43.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:43.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:43.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:42 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:42.881+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:43.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.990+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:43.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.990+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:43.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.990+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:43.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.990+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:43.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:42 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:42.990+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:43.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:43.446+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.496139+0000 front 2024-09-05T07:55:45.496121+0000 (oldest deadline 2024-09-05T07:56:08.996169+0000) 2024-09-05T07:56:43.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:43.446+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:50.696976+0000 front 2024-09-05T07:55:50.697174+0000 (oldest deadline 2024-09-05T07:56:18.297723+0000) 2024-09-05T07:56:43.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:43.446+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:59.398781+0000 front 2024-09-05T07:55:59.399038+0000 (oldest deadline 2024-09-05T07:56:23.498880+0000) 2024-09-05T07:56:43.837 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:43.446+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:11.000782+0000 front 2024-09-05T07:56:11.000754+0000 (oldest deadline 2024-09-05T07:56:32.000916+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8[52967]: 2024-09-05T07:56:43.446+0000 7f3e3fe0b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.802203+0000 front 2024-09-05T07:56:14.802185+0000 (oldest deadline 2024-09-05T07:56:40.702303+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:43.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:43 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:43.410+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:44.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:44.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:44.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:44.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:44.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:44.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:43 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:43.897+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:44.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:43 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:43.956+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:44.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:44 smithi175 podman[68719]: 2024-09-05 07:56:44.043718118 +0000 UTC m=+5.649944939 container died 937261c364a76eb83aae6892deb9849315be86277e7efd3e4c80aec75db52038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-05T07:56:44.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:44 smithi175 podman[68719]: 2024-09-05 07:56:44.424961933 +0000 UTC m=+6.031188754 container cleanup 937261c364a76eb83aae6892deb9849315be86277e7efd3e4c80aec75db52038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-05T07:56:44.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:44 smithi175 bash[68719]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:44.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:44 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:44.393+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:45.040 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:44 smithi175 podman[68733]: 2024-09-05 07:56:44.626445722 +0000 UTC m=+0.577426252 container remove 937261c364a76eb83aae6892deb9849315be86277e7efd3e4c80aec75db52038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-05T07:56:45.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:45.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:45.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:45.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:45.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:45.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:44 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:44.887+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:45.321 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:44.943385698 +0000 UTC m=+0.015955434 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:45.321 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:45.060650378 +0000 UTC m=+0.133220107 container create 8cf872d4cdca3e6a0b2d8dbe9fafddad5b6cc5365622eae41d1da4232f6baff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-91c8a7e) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:45.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:44 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:44.947+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:45.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:45.321878503 +0000 UTC m=+0.394448233 container init 8cf872d4cdca3e6a0b2d8dbe9fafddad5b6cc5365622eae41d1da4232f6baff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-05T07:56:45.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:45.325149672 +0000 UTC m=+0.397719402 container start 8cf872d4cdca3e6a0b2d8dbe9fafddad5b6cc5365622eae41d1da4232f6baff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T07:56:45.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:45.396670337 +0000 UTC m=+0.469240087 container attach 8cf872d4cdca3e6a0b2d8dbe9fafddad5b6cc5365622eae41d1da4232f6baff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:56:45.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 05 07:56:45 smithi175 podman[68818]: 2024-09-05 07:56:45.515074469 +0000 UTC m=+0.587644209 container died 8cf872d4cdca3e6a0b2d8dbe9fafddad5b6cc5365622eae41d1da4232f6baff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:45.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:45.394+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:46.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.8.service' 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:46.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:45 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:45.889+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:46.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:46.215 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-05T07:56:46.215 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-05T07:56:46.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.9 2024-09-05T07:56:46.268 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:46.269 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:46.269 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:46.269 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:46.269 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:46.269 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:45 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:45.959+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:46.426 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:46.426 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:46.426 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:46.426 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:46.426 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:46.427 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:46 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:46.357+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:46.571 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 systemd[1]: Stopping Ceph osd.9 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.597+0000 7f7742a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.597+0000 7f7742a00640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.597+0000 7f7742a00640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:46.912 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:47.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:46 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:46.916+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:47.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:47.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:46 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:46.911+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:47.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:47.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:47.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:47.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:47.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:47.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:47 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:47.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:48.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.878+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:48.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.878+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:48.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.878+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:48.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.878+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:48.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.878+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:48.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:47 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:47.879+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:48.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:47 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:47.949+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:48.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:48 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:48.419+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:49.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:49.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:49.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:49.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:49.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.922+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:49.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:48 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:48.923+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:49.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:48 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:48.957+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:23.130823+0000 front 2024-09-05T07:56:23.130848+0000 (oldest deadline 2024-09-05T07:56:48.430884+0000) 2024-09-05T07:56:49.737 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:49.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:49.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:49.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:49.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:49.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:49.397+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:50.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:50.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:50.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:50.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:50.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:50.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:49 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:49.911+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:50.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:49 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:49.960+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:23.130823+0000 front 2024-09-05T07:56:23.130848+0000 (oldest deadline 2024-09-05T07:56:48.430884+0000) 2024-09-05T07:56:50.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:50.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:50.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:50.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:50.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:50.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:50 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:50.414+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:51.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:51.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:51.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:51.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:51.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:51.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:50 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:50.888+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:51.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.022522+0000 front 2024-09-05T07:55:36.022677+0000 (oldest deadline 2024-09-05T07:56:00.722568+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:46.524413+0000 front 2024-09-05T07:55:46.524341+0000 (oldest deadline 2024-09-05T07:56:07.024342+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.426250+0000 front 2024-09-05T07:55:53.426189+0000 (oldest deadline 2024-09-05T07:56:18.726160+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:55:58.726590+0000 front 2024-09-05T07:55:58.726511+0000 (oldest deadline 2024-09-05T07:56:23.426725+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.829348+0000 front 2024-09-05T07:56:10.829325+0000 (oldest deadline 2024-09-05T07:56:32.529277+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.230543+0000 front 2024-09-05T07:56:17.230570+0000 (oldest deadline 2024-09-05T07:56:43.130369+0000) 2024-09-05T07:56:51.322 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:51 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9[63693]: 2024-09-05T07:56:51.005+0000 7f773e400640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:23.130823+0000 front 2024-09-05T07:56:23.130848+0000 (oldest deadline 2024-09-05T07:56:48.430884+0000) 2024-09-05T07:56:51.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:51.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:51.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:51.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:51.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:51.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:51 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:51.444+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:52.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:52.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:52.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:52.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:52.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:52.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:51 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:51.909+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:52.321 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:52 smithi144 podman[85967]: 2024-09-05 07:56:52.042295768 +0000 UTC m=+5.546872172 container died d5be7492d0bdc7ed24a26ac9a73bf064138aca6d69b26433e6b03dbda3326bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T07:56:52.719 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:52 smithi144 podman[85967]: 2024-09-05 07:56:52.442373659 +0000 UTC m=+5.946950061 container cleanup d5be7492d0bdc7ed24a26ac9a73bf064138aca6d69b26433e6b03dbda3326bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:56:52.719 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:52 smithi144 bash[85967]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:52.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:52 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:52.413+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:53.071 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:52 smithi144 podman[85983]: 2024-09-05 07:56:52.71847073 +0000 UTC m=+0.662257986 container remove d5be7492d0bdc7ed24a26ac9a73bf064138aca6d69b26433e6b03dbda3326bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:53.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:52 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:52.904+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:53.413 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.060000786 +0000 UTC m=+0.026749772 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:56:53.413 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.16970013 +0000 UTC m=+0.136449099 container create 89a1ee10da0ca5b04a9c1662bcc77881c6ee6741609de78e5459e3af9f897939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-05T07:56:53.413 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.412865827 +0000 UTC m=+0.379614818 container init 89a1ee10da0ca5b04a9c1662bcc77881c6ee6741609de78e5459e3af9f897939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T07:56:53.677 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.420086704 +0000 UTC m=+0.386835674 container start 89a1ee10da0ca5b04a9c1662bcc77881c6ee6741609de78e5459e3af9f897939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-05T07:56:53.677 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.521947054 +0000 UTC m=+0.488696027 container attach 89a1ee10da0ca5b04a9c1662bcc77881c6ee6741609de78e5459e3af9f897939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:53.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:53.420+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:53.999 INFO:journalctl@ceph.osd.9.smithi144.stdout:Sep 05 07:56:53 smithi144 podman[86071]: 2024-09-05 07:56:53.677071629 +0000 UTC m=+0.643820613 container died 89a1ee10da0ca5b04a9c1662bcc77881c6ee6741609de78e5459e3af9f897939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-05T07:56:54.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:54.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:54.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:54.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:54.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:54.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:54.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:53 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:53.928+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:54.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.9.service' 2024-09-05T07:56:54.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:56:54.429 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-05T07:56:54.429 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-05T07:56:54.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.10 2024-09-05T07:56:54.731 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 systemd[1]: Stopping Ceph osd.10 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:56:54.732 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.731+0000 7f1fd671b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:56:54.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:54.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:54.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:54.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:54.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:54.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:54 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:54.392+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:55.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.731+0000 7f1fd671b640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-05T07:56:55.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.731+0000 7f1fd671b640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:56:55.187 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:55.188 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:54 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:54.966+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:55.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:55.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:55.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:55.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:55.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:55.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:55 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:55.405+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:56.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:56.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:56.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:56.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:56.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:56.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:56.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.002+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:56.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:56.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:56.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:56.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:56.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:56.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:56 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:56.384+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:57.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:57.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:57.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:57.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:57.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:57.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:57.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:56 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:56.957+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:57.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:57.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:57 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:57.377+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:56:58.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:58.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:58.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:58.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:58.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:58.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:58.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:57 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:57.997+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:58.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:58.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:58.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:58.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:58.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:58.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:58.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:58 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:58.385+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:56:59.437 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.190624+0000 front 2024-09-05T07:55:36.190547+0000 (oldest deadline 2024-09-05T07:56:04.391277+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:44.391654+0000 front 2024-09-05T07:55:44.391551+0000 (oldest deadline 2024-09-05T07:56:09.091771+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:49.092296+0000 front 2024-09-05T07:55:49.092433+0000 (oldest deadline 2024-09-05T07:56:17.892763+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:02.593909+0000 front 2024-09-05T07:56:02.594039+0000 (oldest deadline 2024-09-05T07:56:24.893780+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:07.194461+0000 front 2024-09-05T07:56:07.194500+0000 (oldest deadline 2024-09-05T07:56:33.094572+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:17.795700+0000 front 2024-09-05T07:56:17.795643+0000 (oldest deadline 2024-09-05T07:56:41.895578+0000) 2024-09-05T07:56:59.438 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:56:59 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10[58873]: 2024-09-05T07:56:59.011+0000 7f1fd2d31640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6822 osd.6 since back 2024-09-05T07:56:22.996639+0000 front 2024-09-05T07:56:22.996727+0000 (oldest deadline 2024-09-05T07:56:53.597130+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:56:59.794 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:56:59 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:56:59.415+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:00.315 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 podman[67926]: 2024-09-05 07:57:00.047654139 +0000 UTC m=+5.419110215 container died e156d7359bd6eb8104e782038031cb60487b894d242c465881ab51f24a0f919b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-05T07:57:00.665 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 podman[67926]: 2024-09-05 07:57:00.41437107 +0000 UTC m=+5.785827187 container cleanup e156d7359bd6eb8104e782038031cb60487b894d242c465881ab51f24a0f919b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:00.665 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 bash[67926]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10 2024-09-05T07:57:00.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:00.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:00.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:00.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:00.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:00.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:00.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:00 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:00.439+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:00.937 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 podman[67941]: 2024-09-05 07:57:00.665473755 +0000 UTC m=+0.611124152 container remove e156d7359bd6eb8104e782038031cb60487b894d242c465881ab51f24a0f919b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-05T07:57:01.276 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 podman[68027]: 2024-09-05 07:57:00.876628287 +0000 UTC m=+0.016009754 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:57:01.277 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:00 smithi154 podman[68027]: 2024-09-05 07:57:00.98300655 +0000 UTC m=+0.122387999 container create 445f9221ae32c5b5f3ec8b780aee0df7dd6ce5f901887e60746113dc4f8ca856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_CLEAN=True) 2024-09-05T07:57:01.277 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:01 smithi154 podman[68027]: 2024-09-05 07:57:01.194123159 +0000 UTC m=+0.333504632 container init 445f9221ae32c5b5f3ec8b780aee0df7dd6ce5f901887e60746113dc4f8ca856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e) 2024-09-05T07:57:01.277 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:01 smithi154 podman[68027]: 2024-09-05 07:57:01.197523956 +0000 UTC m=+0.336905405 container start 445f9221ae32c5b5f3ec8b780aee0df7dd6ce5f901887e60746113dc4f8ca856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:01.277 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:01 smithi154 podman[68027]: 2024-09-05 07:57:01.276950281 +0000 UTC m=+0.416331745 container attach 445f9221ae32c5b5f3ec8b780aee0df7dd6ce5f901887e60746113dc4f8ca856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:01.663 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 05 07:57:01 smithi154 podman[68027]: 2024-09-05 07:57:01.38291156 +0000 UTC m=+0.522293013 container died 445f9221ae32c5b5f3ec8b780aee0df7dd6ce5f901887e60746113dc4f8ca856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T07:57:01.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:01.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:01.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:01.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:01.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:01.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:01.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:01 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:01.429+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:01.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.10.service' 2024-09-05T07:57:02.011 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:02.011 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-05T07:57:02.012 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-05T07:57:02.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.11 2024-09-05T07:57:02.302 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 systemd[1]: Stopping Ceph osd.11 for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:02.587 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.301+0000 7f39e5194640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:02.587 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.301+0000 7f39e5194640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-05T07:57:02.587 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.301+0000 7f39e5194640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T07:57:02.587 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:02.587 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:02.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:02.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:02.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:02.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:02.588 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:02 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:02.402+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:03.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:03.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:03 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:03.435+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:04.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:04.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:04 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:04.463+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:05.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:05.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:05.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:05.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:05.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:05.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:05.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:05 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:05.460+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:06.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6806 osd.0 since back 2024-09-05T07:55:36.457996+0000 front 2024-09-05T07:55:36.458172+0000 (oldest deadline 2024-09-05T07:56:01.158124+0000) 2024-09-05T07:57:06.837 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-05T07:55:45.060450+0000 front 2024-09-05T07:55:45.060605+0000 (oldest deadline 2024-09-05T07:56:08.560482+0000) 2024-09-05T07:57:06.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-05T07:55:53.861471+0000 front 2024-09-05T07:55:53.861621+0000 (oldest deadline 2024-09-05T07:56:17.961751+0000) 2024-09-05T07:57:06.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6814 osd.3 since back 2024-09-05T07:56:01.463086+0000 front 2024-09-05T07:56:01.463099+0000 (oldest deadline 2024-09-05T07:56:25.562934+0000) 2024-09-05T07:57:06.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-05T07:56:10.164275+0000 front 2024-09-05T07:56:10.164242+0000 (oldest deadline 2024-09-05T07:56:34.864287+0000) 2024-09-05T07:57:06.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-05T07:56:14.864559+0000 front 2024-09-05T07:56:14.864608+0000 (oldest deadline 2024-09-05T07:56:41.265134+0000) 2024-09-05T07:57:06.838 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:06 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11[59955]: 2024-09-05T07:57:06.469+0000 7f39e17aa640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-05T07:56:33.467591+0000 front 2024-09-05T07:56:33.467518+0000 (oldest deadline 2024-09-05T07:56:56.967405+0000) 2024-09-05T07:57:08.076 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:07 smithi175 podman[68931]: 2024-09-05 07:57:07.756310977 +0000 UTC m=+5.545289202 container died 3c11ecccf2a06917d7929db166b8feebd4dfc61cffe3a51d1c2206c44c875aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-05T07:57:08.076 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[68931]: 2024-09-05 07:57:08.076750598 +0000 UTC m=+5.865728864 container cleanup 3c11ecccf2a06917d7929db166b8feebd4dfc61cffe3a51d1c2206c44c875aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T07:57:08.337 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 bash[68931]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11 2024-09-05T07:57:08.338 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[68946]: 2024-09-05 07:57:08.294380687 +0000 UTC m=+0.531307938 container remove 3c11ecccf2a06917d7929db166b8feebd4dfc61cffe3a51d1c2206c44c875aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-05T07:57:09.030 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[69031]: 2024-09-05 07:57:08.711826896 +0000 UTC m=+0.090995575 container create f9c8893f88f761da6007508f69d957489fb1362399e5020fd4b52871131a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-05T07:57:09.030 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[69031]: 2024-09-05 07:57:08.636223266 +0000 UTC m=+0.015391953 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T07:57:09.031 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[69031]: 2024-09-05 07:57:08.947327273 +0000 UTC m=+0.326495947 container init f9c8893f88f761da6007508f69d957489fb1362399e5020fd4b52871131a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e) 2024-09-05T07:57:09.031 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:08 smithi175 podman[69031]: 2024-09-05 07:57:08.950860337 +0000 UTC m=+0.330029022 container start f9c8893f88f761da6007508f69d957489fb1362399e5020fd4b52871131a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.license=GPLv2) 2024-09-05T07:57:09.031 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:09 smithi175 podman[69031]: 2024-09-05 07:57:09.030583736 +0000 UTC m=+0.409752423 container attach f9c8893f88f761da6007508f69d957489fb1362399e5020fd4b52871131a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-05T07:57:09.337 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 05 07:57:09 smithi175 podman[69031]: 2024-09-05 07:57:09.131052573 +0000 UTC m=+0.510221258 container died f9c8893f88f761da6007508f69d957489fb1362399e5020fd4b52871131a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-05T07:57:09.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@osd.11.service' 2024-09-05T07:57:09.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:09.789 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-05T07:57:09.790 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-05T07:57:09.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.a 2024-09-05T07:57:10.213 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:09 smithi144 systemd[1]: Stopping Ceph mds.a for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:10.572 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: 2024-09-05T07:57:10.212+0000 7fc73bc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:10.573 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:10 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a[70548]: 2024-09-05T07:57:10.212+0000 7fc73bc00640 -1 mds.a *** got signal Terminated *** 2024-09-05T07:57:12.279 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:11 smithi144 podman[86188]: 2024-09-05 07:57:11.970285052 +0000 UTC m=+1.890313079 container died 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-05T07:57:12.571 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:12 smithi144 podman[86188]: 2024-09-05 07:57:12.38436702 +0000 UTC m=+2.304395045 container cleanup 31e60f2d4633df7eff2bdd1cc819b276274ca1046e40fa67de3737e73351de1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-05T07:57:12.572 INFO:journalctl@ceph.mds.a.smithi144.stdout:Sep 05 07:57:12 smithi144 bash[86188]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-a 2024-09-05T07:57:12.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.a.service' 2024-09-05T07:57:12.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:12.877 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-05T07:57:12.878 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-05T07:57:12.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.d 2024-09-05T07:57:13.258 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:12 smithi144 systemd[1]: Stopping Ceph mds.d for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:13.571 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: 2024-09-05T07:57:13.257+0000 7f31f4600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:13.571 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:13 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d[69354]: 2024-09-05T07:57:13.257+0000 7f31f4600640 -1 mds.d *** got signal Terminated *** 2024-09-05T07:57:16.231 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:15 smithi144 podman[86308]: 2024-09-05 07:57:15.970862724 +0000 UTC m=+2.824914444 container died 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-05T07:57:16.505 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:16 smithi144 podman[86308]: 2024-09-05 07:57:16.3374348 +0000 UTC m=+3.191486519 container cleanup 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e) 2024-09-05T07:57:16.505 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:16 smithi144 bash[86308]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d 2024-09-05T07:57:16.808 INFO:journalctl@ceph.mds.d.smithi144.stdout:Sep 05 07:57:16 smithi144 podman[86319]: 2024-09-05 07:57:16.555571907 +0000 UTC m=+0.573316328 container remove 27f4e54f12ee7d0d58340dd05403dc37374d3f42003eba3f28a9998d97d08011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:57:16.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.d.service' 2024-09-05T07:57:16.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:16.903 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-05T07:57:16.903 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-05T07:57:16.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.g 2024-09-05T07:57:17.286 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:16 smithi144 systemd[1]: Stopping Ceph mds.g for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:17.571 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g[70162]: 2024-09-05T07:57:17.285+0000 7fe2fae00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:17.571 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:17 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g[70162]: 2024-09-05T07:57:17.285+0000 7fe2fae00640 -1 mds.g *** got signal Terminated *** 2024-09-05T07:57:20.822 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:20 smithi144 podman[86428]: 2024-09-05 07:57:20.543532088 +0000 UTC m=+3.374314039 container died a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-05T07:57:21.217 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:20 smithi144 podman[86428]: 2024-09-05 07:57:20.916247678 +0000 UTC m=+3.747029626 container cleanup a1cce3d75decffe5ba0723323551f5a3fd8143b9628a9ef2f99456cd0316e04c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:21.217 INFO:journalctl@ceph.mds.g.smithi144.stdout:Sep 05 07:57:20 smithi144 bash[86428]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-g 2024-09-05T07:57:21.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.g.service' 2024-09-05T07:57:21.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:21.484 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-05T07:57:21.484 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-05T07:57:21.484 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.j 2024-09-05T07:57:21.821 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:21 smithi144 systemd[1]: Stopping Ceph mds.j for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:22.321 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j[68997]: 2024-09-05T07:57:21.863+0000 7f26d4600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:22.322 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:21 smithi144 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j[68997]: 2024-09-05T07:57:21.863+0000 7f26d4600640 -1 mds.j *** got signal Terminated *** 2024-09-05T07:57:23.729 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:23 smithi144 podman[86547]: 2024-09-05 07:57:23.467000637 +0000 UTC m=+1.714720050 container died 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-05T07:57:24.012 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:23 smithi144 podman[86547]: 2024-09-05 07:57:23.819385774 +0000 UTC m=+2.067105182 container cleanup 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:24.012 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:23 smithi144 bash[86547]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j 2024-09-05T07:57:24.272 INFO:journalctl@ceph.mds.j.smithi144.stdout:Sep 05 07:57:24 smithi144 podman[86559]: 2024-09-05 07:57:24.011893075 +0000 UTC m=+0.539236007 container remove 1d7edf6a91033769433abddc62f1caa36033cbeb5a9f04f19f63b5a7e82354ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-j, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-05T07:57:24.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.j.service' 2024-09-05T07:57:24.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:24.360 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-05T07:57:24.360 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-05T07:57:24.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.b 2024-09-05T07:57:24.411 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:24 smithi154 systemd[1]: Stopping Ceph mds.b for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:24.937 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: 2024-09-05T07:57:24.656+0000 7fcda27d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:24.937 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:24 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b[64089]: 2024-09-05T07:57:24.656+0000 7fcda27d4640 -1 mds.b *** got signal Terminated *** 2024-09-05T07:57:28.173 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:27 smithi154 podman[68142]: 2024-09-05 07:57:27.920841403 +0000 UTC m=+3.362972086 container died d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-05T07:57:28.437 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 podman[68142]: 2024-09-05 07:57:28.255921922 +0000 UTC m=+3.698052606 container cleanup d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:28.437 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 bash[68142]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b 2024-09-05T07:57:28.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.b.service' 2024-09-05T07:57:28.709 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 podman[68153]: 2024-09-05 07:57:28.448746527 +0000 UTC m=+0.521653723 container remove d31e1ed2906c74075a6476c68f0a19a41eeb2ac739770843f63c23e56a1f752b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T07:57:28.709 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-05T07:57:28.709 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 systemd[1]: Stopped Ceph mds.b for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:57:28.709 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 05 07:57:28 smithi154 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.b.service: Consumed 2.763s CPU time. 2024-09-05T07:57:28.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:28.723 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-05T07:57:28.724 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-05T07:57:28.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.e 2024-09-05T07:57:29.043 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:28 smithi154 systemd[1]: Stopping Ceph mds.e for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:29.437 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: 2024-09-05T07:57:29.042+0000 7f61b1da4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:29.437 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:29 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e[63479]: 2024-09-05T07:57:29.042+0000 7f61b1da4640 -1 mds.e *** got signal Terminated *** 2024-09-05T07:57:32.187 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:31 smithi154 podman[68261]: 2024-09-05 07:57:31.897845236 +0000 UTC m=+2.957134192 container died 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-05T07:57:32.527 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:32 smithi154 podman[68261]: 2024-09-05 07:57:32.301359034 +0000 UTC m=+3.360647978 container cleanup 4ac63d4a6a53996d46111b72145c677741733a85879c2898c02d6811b6827323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-05T07:57:32.527 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 05 07:57:32 smithi154 bash[68261]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-e 2024-09-05T07:57:32.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.e.service' 2024-09-05T07:57:32.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:32.711 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-05T07:57:32.711 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-05T07:57:32.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.h 2024-09-05T07:57:33.187 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:32 smithi154 systemd[1]: Stopping Ceph mds.h for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:33.187 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: 2024-09-05T07:57:33.004+0000 7f3a146ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:33.187 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:33 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h[63792]: 2024-09-05T07:57:33.004+0000 7f3a146ac640 -1 mds.h *** got signal Terminated *** 2024-09-05T07:57:36.187 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:35 smithi154 podman[68382]: 2024-09-05 07:57:35.91093192 +0000 UTC m=+2.983652392 container died a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-05T07:57:36.481 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:36 smithi154 podman[68382]: 2024-09-05 07:57:36.230095968 +0000 UTC m=+3.302816436 container cleanup a952dfd077cfaa62e8089feec388e5ada1167a190c7f3c43c60d6101a1fca443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-05T07:57:36.481 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 05 07:57:36 smithi154 bash[68382]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-h 2024-09-05T07:57:36.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.h.service' 2024-09-05T07:57:36.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:36.733 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-05T07:57:36.733 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-05T07:57:36.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.k 2024-09-05T07:57:37.187 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:36 smithi154 systemd[1]: Stopping Ceph mds.k for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:37.187 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: 2024-09-05T07:57:37.042+0000 7f784ff20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:37.187 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:37 smithi154 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k[63160]: 2024-09-05T07:57:37.042+0000 7f784ff20640 -1 mds.k *** got signal Terminated *** 2024-09-05T07:57:40.187 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:39 smithi154 podman[68515]: 2024-09-05 07:57:39.909672703 +0000 UTC m=+2.958121401 container died e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, ceph=True, GIT_CLEAN=True) 2024-09-05T07:57:40.543 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 podman[68515]: 2024-09-05 07:57:40.359295749 +0000 UTC m=+3.407744451 container cleanup e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-05T07:57:40.543 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 bash[68515]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k 2024-09-05T07:57:40.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.k.service' 2024-09-05T07:57:40.793 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 podman[68527]: 2024-09-05 07:57:40.543177855 +0000 UTC m=+0.623163841 container remove e5e4b0a26e9ae4acd1ac8f314191c77e21b828c70e879d7c85e7b7b92ab4bf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T07:57:40.793 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-05T07:57:40.793 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 systemd[1]: Stopped Ceph mds.k for 17138d32-6b5a-11ef-bcd6-c7b262605968. 2024-09-05T07:57:40.793 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 05 07:57:40 smithi154 systemd[1]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.k.service: Consumed 1.463s CPU time. 2024-09-05T07:57:40.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:40.804 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-05T07:57:40.804 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-05T07:57:40.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.c 2024-09-05T07:57:41.087 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:40 smithi175 systemd[1]: Stopping Ceph mds.c for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:41.837 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c[64797]: 2024-09-05T07:57:41.340+0000 7f293909a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:41.837 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:41 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c[64797]: 2024-09-05T07:57:41.340+0000 7f293909a640 -1 mds.c *** got signal Terminated *** 2024-09-05T07:57:44.258 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:43 smithi175 podman[69134]: 2024-09-05 07:57:43.902954819 +0000 UTC m=+2.901116085 container died 7768834dd0f8a984dd2b869a5dcdf77cc2cc58659fda97b4c93fb8cc1f9200e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e) 2024-09-05T07:57:44.587 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:44 smithi175 podman[69134]: 2024-09-05 07:57:44.357453874 +0000 UTC m=+3.355615138 container cleanup 7768834dd0f8a984dd2b869a5dcdf77cc2cc58659fda97b4c93fb8cc1f9200e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-05T07:57:44.587 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 05 07:57:44 smithi175 bash[69134]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-c 2024-09-05T07:57:44.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.c.service' 2024-09-05T07:57:44.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:44.828 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-05T07:57:44.828 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-05T07:57:44.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.f 2024-09-05T07:57:45.253 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:44 smithi175 systemd[1]: Stopping Ceph mds.f for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: 2024-09-05T07:57:45.252+0000 7f6b28493640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:45.587 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:45 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f[64481]: 2024-09-05T07:57:45.252+0000 7f6b28493640 -1 mds.f *** got signal Terminated *** 2024-09-05T07:57:48.221 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:47 smithi175 podman[69267]: 2024-09-05 07:57:47.907598736 +0000 UTC m=+2.864063514 container died 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-05T07:57:48.521 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:48 smithi175 podman[69267]: 2024-09-05 07:57:48.311603774 +0000 UTC m=+3.268068555 container cleanup 18b5423e506b3af5166d79664e8a07c54b9475013d4fe758f3df1635064f8d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-05T07:57:48.521 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 05 07:57:48 smithi175 bash[69267]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-f 2024-09-05T07:57:48.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.f.service' 2024-09-05T07:57:48.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:48.695 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-05T07:57:48.696 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-05T07:57:48.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.i 2024-09-05T07:57:49.087 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:48 smithi175 systemd[1]: Stopping Ceph mds.i for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:49.088 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: 2024-09-05T07:57:49.014+0000 7fb6655d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:49.088 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:49 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i[65099]: 2024-09-05T07:57:49.014+0000 7fb6655d2640 -1 mds.i *** got signal Terminated *** 2024-09-05T07:57:52.240 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:51 smithi175 podman[69388]: 2024-09-05 07:57:51.91456009 +0000 UTC m=+3.003790959 container died 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-05T07:57:52.508 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:52 smithi175 podman[69388]: 2024-09-05 07:57:52.340121852 +0000 UTC m=+3.429352718 container cleanup 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-05T07:57:52.508 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:52 smithi175 bash[69388]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i 2024-09-05T07:57:52.758 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 05 07:57:52 smithi175 podman[69401]: 2024-09-05 07:57:52.508196672 +0000 UTC m=+0.596129252 container remove 4a303aa159cb2efa9faa615151388331dd97ce1f4b96476097882092eda55d98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-05T07:57:52.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.i.service' 2024-09-05T07:57:52.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:52.795 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-05T07:57:52.795 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-05T07:57:52.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.l 2024-09-05T07:57:53.087 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:52 smithi175 systemd[1]: Stopping Ceph mds.l for 17138d32-6b5a-11ef-bcd6-c7b262605968... 2024-09-05T07:57:53.371 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: 2024-09-05T07:57:53.109+0000 7f3cb3b94640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T07:57:53.371 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:53 smithi175 ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l[64180]: 2024-09-05T07:57:53.109+0000 7f3cb3b94640 -1 mds.l *** got signal Terminated *** 2024-09-05T07:57:56.337 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:55 smithi175 podman[69508]: 2024-09-05 07:57:55.916538611 +0000 UTC m=+2.901942709 container died ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-05T07:57:56.636 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:56 smithi175 podman[69508]: 2024-09-05 07:57:56.452193938 +0000 UTC m=+3.437598081 container cleanup ac38318634da0bcd33ffbbe4cbf44b92c50997746f1c02617833d97a961dd5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T07:57:56.636 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 05 07:57:56 smithi175 bash[69508]: ceph-17138d32-6b5a-11ef-bcd6-c7b262605968-mds-l 2024-09-05T07:57:56.856 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-17138d32-6b5a-11ef-bcd6-c7b262605968@mds.l.service' 2024-09-05T07:57:56.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T07:57:56.889 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-05T07:57:56.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T07:57:57.163 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:01.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T07:58:01.244 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:03.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T07:58:03.832 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:06.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:58:06.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:58:06.527 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T07:58:06.555 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-05T07:58:06.557 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi144/crash 2024-09-05T07:58:06.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T07:58:06.625 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T07:58:06.625 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2024-09-05T07:58:06.628 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi154/crash 2024-09-05T07:58:06.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T07:58:06.668 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T07:58:06.668 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-05T07:58:06.670 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi175/crash 2024-09-05T07:58:06.671 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T07:58:06.726 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T07:58:06.726 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-09-05T07:58:06.727 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-05T07:58:06.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-05T07:58:06.819 INFO:tasks.cephadm:Compressing logs... 2024-09-05T07:58:06.819 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T07:58:06.823 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T07:58:06.825 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T07:58:06.850 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T07:58:06.851 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-09-05T07:58:06.851 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T07:58:06.851 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.i.log 2024-09-05T07:58:06.851 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.c.log 2024-09-05T07:58:06.853 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.11.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.c.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.2.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr: 82.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.11.log: -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.5.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.l.log 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr: 90.4% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T07:58:06.854 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.5.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.8.log 2024-09-05T07:58:06.855 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.l.log: 86.3% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.10.log 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.1.log 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.7.log 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.10.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T07:58:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.b.log 2024-09-05T07:58:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.k.log 2024-09-05T07:58:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.b.log: --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.4.log 2024-09-05T07:58:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T07:58:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T07:58:06.860 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T07:58:06.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.y.log 2024-09-05T07:58:06.861 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T07:58:06.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T07:58:06.862 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T07:58:06.863 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.z.log 2024-09-05T07:58:06.863 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.c.log 2024-09-05T07:58:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.y.log: 92.3% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.y.log.gz 2024-09-05T07:58:06.868 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T07:58:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.h.log 2024-09-05T07:58:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.b.log 2024-09-05T07:58:06.869 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.z.log.gz 2024-09-05T07:58:06.870 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.h.log: 86.2% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T07:58:06.874 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.0.log 2024-09-05T07:58:06.874 INFO:teuthology.orchestra.run.smithi144.stderr:: No such file or directory 2024-09-05T07:58:06.875 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.9.log 2024-09-05T07:58:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T07:58:06.877 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.0.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T07:58:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.a.log 2024-09-05T07:58:06.879 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.f.log 2024-09-05T07:58:06.879 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T07:58:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.a.log 2024-09-05T07:58:06.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.e.log 2024-09-05T07:58:06.883 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T07:58:06.883 INFO:teuthology.orchestra.run.smithi144.stderr: 90.3% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T07:58:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.g.log 2024-09-05T07:58:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.6.log 2024-09-05T07:58:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.g.log: /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T07:58:06.889 INFO:teuthology.orchestra.run.smithi144.stderr: 94.5% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.g.log.gz 2024-09-05T07:58:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.d.log 2024-09-05T07:58:06.891 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T07:58:06.891 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.x.log 2024-09-05T07:58:06.892 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.f.log: 92.4% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.i.log.gz 2024-09-05T07:58:06.893 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.l.log.gz 2024-09-05T07:58:06.894 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T07:58:06.895 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.j.log 2024-09-05T07:58:06.897 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.x.log: 86.3% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T07:58:06.897 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T07:58:06.898 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.e.log: 94.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.k.log.gz 2024-09-05T07:58:06.899 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.3.log 2024-09-05T07:58:06.900 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T07:58:06.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T07:58:06.909 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T07:58:06.913 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.j.log.gz 2024-09-05T07:58:06.913 INFO:teuthology.orchestra.run.smithi175.stderr: 93.1% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.c.log.gz 2024-09-05T07:58:06.922 INFO:teuthology.orchestra.run.smithi144.stderr: 92.9% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.a.log.gz 2024-09-05T07:58:06.929 INFO:teuthology.orchestra.run.smithi175.stderr: 92.7% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.f.log.gz 2024-09-05T07:58:06.931 INFO:teuthology.orchestra.run.smithi144.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T07:58:06.939 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.e.log.gz 2024-09-05T07:58:06.944 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.h.log.gz 2024-09-05T07:58:06.952 INFO:teuthology.orchestra.run.smithi144.stderr: 94.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.d.log.gz 2024-09-05T07:58:07.115 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mds.b.log.gz 2024-09-05T07:58:07.138 INFO:teuthology.orchestra.run.smithi144.stderr: 90.1% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mgr.x.log.gz 2024-09-05T07:58:07.160 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.c.log.gz 2024-09-05T07:58:07.179 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.b.log.gz 2024-09-05T07:58:07.675 INFO:teuthology.orchestra.run.smithi144.stderr: 90.5% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-mon.a.log.gz 2024-09-05T07:58:09.434 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.9.log.gz 2024-09-05T07:58:09.951 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.11.log.gz 2024-09-05T07:58:09.999 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.8.log.gz 2024-09-05T07:58:10.076 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.5.log.gz 2024-09-05T07:58:10.162 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.10.log.gz 2024-09-05T07:58:10.255 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.4.log.gz 2024-09-05T07:58:10.439 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.7.log.gz 2024-09-05T07:58:10.464 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.2.log.gz 2024-09-05T07:58:10.466 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-05T07:58:10.466 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m3.626s 2024-09-05T07:58:10.466 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m13.069s 2024-09-05T07:58:10.466 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.490s 2024-09-05T07:58:11.019 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.1.log.gz 2024-09-05T07:58:11.021 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-05T07:58:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m4.180s 2024-09-05T07:58:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m14.659s 2024-09-05T07:58:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.546s 2024-09-05T07:58:11.195 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.6.log.gz 2024-09-05T07:58:11.221 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.0.log.gz 2024-09-05T07:58:11.520 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/17138d32-6b5a-11ef-bcd6-c7b262605968/ceph-osd.3.log.gz 2024-09-05T07:58:11.526 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-05T07:58:11.526 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m4.672s 2024-09-05T07:58:11.526 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m15.571s 2024-09-05T07:58:11.526 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m1.464s 2024-09-05T07:58:11.527 INFO:tasks.cephadm:Archiving logs... 2024-09-05T07:58:11.527 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi144/log 2024-09-05T07:58:11.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T07:58:13.685 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi154/log 2024-09-05T07:58:13.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T07:58:15.986 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi175/log 2024-09-05T07:58:15.987 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T07:58:17.911 INFO:tasks.cephadm:Removing cluster... 2024-09-05T07:58:17.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force 2024-09-05T07:58:18.182 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:18.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force 2024-09-05T07:58:18.869 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:19.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 17138d32-6b5a-11ef-bcd6-c7b262605968 --force 2024-09-05T07:58:19.422 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 17138d32-6b5a-11ef-bcd6-c7b262605968 2024-09-05T07:58:19.690 INFO:tasks.cephadm:Removing cephadm ... 2024-09-05T07:58:19.690 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T07:58:19.732 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T07:58:19.749 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T07:58:19.765 INFO:tasks.cephadm:Teardown complete 2024-09-05T07:58:19.766 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T07:58:19.779 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T07:58:19.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T07:58:19.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T07:58:19.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T07:58:19.903 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T07:58:19.912 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T07:58:19.912 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:58:19.917 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:58:19.920 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:58:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:58:19.936 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:58:19.937 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:58:19.937 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-05T07:58:19.937 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +796us[ +771us] +/- 45ms 2024-09-05T07:58:19.938 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1441us[-1466us] +/- 59ms 2024-09-05T07:58:19.938 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +561us[ +537us] +/- 83ms 2024-09-05T07:58:19.938 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +794us[ +786us] +/- 45ms 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1432us[-1440us] +/- 59ms 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +563us[ +563us] +/- 83ms 2024-09-05T07:58:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:58:19.946 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:58:19.953 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:58:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-05T07:58:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +793us[ +790us] +/- 45ms 2024-09-05T07:58:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1436us[-1439us] +/- 59ms 2024-09-05T07:58:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +546us[ +543us] +/- 83ms 2024-09-05T07:58:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:58:19.955 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T07:58:19.965 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T07:58:19.965 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T07:58:19.975 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T07:58:20.119 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T07:58:20.186 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T07:58:20.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:58:20.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:20.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:58:20.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:20.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:58:20.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:20.371 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T07:58:20.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T07:58:20.395 INFO:teuthology.task.internal:Duration was 1467.326406 seconds 2024-09-05T07:58:20.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T07:58:20.486 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T07:58:20.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T07:58:20.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T07:58:20.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T07:58:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:58:20.532 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:58:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:58:20.975 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T07:58:20.975 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-05T07:58:20.976 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T07:58:21.024 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-05T07:58:21.024 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T07:58:21.054 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-05T07:58:21.054 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T07:58:21.078 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T07:58:21.078 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T07:58:21.082 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T07:58:21.097 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T07:58:21.145 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T07:58:21.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T07:58:21.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T07:58:21.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T07:58:21.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T07:58:21.713 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T07:58:21.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T07:58:21.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T07:58:21.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T07:58:21.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T07:58:21.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.839 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.860 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-05T07:58:21.884 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-05T07:58:21.903 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-05T07:58:21.933 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:21.966 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:21.981 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T07:58:21.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:58:21.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T07:58:22.010 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T07:58:22.011 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi144 2024-09-05T07:58:22.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T07:58:22.087 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi154 2024-09-05T07:58:22.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T07:58:22.124 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890031/remote/smithi175 2024-09-05T07:58:22.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T07:58:22.161 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T07:58:22.161 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T07:58:22.166 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T07:58:22.168 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T07:58:22.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T07:58:22.223 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T07:58:22.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T07:58:22.233 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T07:58:22.234 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T07:58:22.240 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T07:58:22.243 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T07:58:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 07:58 /home/ubuntu/cephtest 2024-09-05T07:58:22.265 INFO:teuthology.orchestra.run.smithi175.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 07:58 /home/ubuntu/cephtest 2024-09-05T07:58:22.271 INFO:teuthology.orchestra.run.smithi144.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 07:58 /home/ubuntu/cephtest 2024-09-05T07:58:22.273 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T07:58:22.285 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T07:58:22.312 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} duration: 1467.3264064788818 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-05T07:58:22.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T07:58:22.416 INFO:teuthology.run:pass